00000001:02000400:1.0F:1784755831.886223:0:2968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1784755849.163294:0:3191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1784755851.152749:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 671 MB/s 00000001:01000000:0.0F:1784755851.404938:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 714 MB/s 00000001:01000000:2.0F:1784755851.657258:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3591 MB/s 00000020:02000000:2.0:1784755852.443477:0:3283:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_g9c9e10a 00000400:02000000:2.0:1784755853.546363:0:3298:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.202.108@tcp [8/256/0/180] 00008000:02000000:1.0:1784755857.389161:0:3448:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784755903.260328:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1784755911.605005:0:5776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784755911.605010:0:5776:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1784755911.605145:0:5776:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000003914a3f8 00000080:02000400:1.0:1784755911.605157:0:5776:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1784755911.610256:0:5776:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1784755911.610270:0:5776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784755911.610309:0:5776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009954e839) 00000020:00000080:1.0:1784755911.610344:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784755911.624872:0:5776:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784755911.625258:0:5776:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784755911.667950:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784755911.667992:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784755911.668014:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784755911.668067:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784755911.668096:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784755911.668481:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784755911.668489:0:5776:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784755911.668500:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c32bc 00000020:01000004:1.0:1784755911.668508:0:5776:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1784755911.668513:0:5776:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784755911.668517:0:5776:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003914a3f8 from MGS 00000020:01000004:1.0:1784755911.668522:0:5776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784755911.668531:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a6f9982) 00000020:00000080:1.0:1784755911.668541:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784755911.668603:0:5776:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003914a3f8 from MGS, refs=2 00080000:01000000:1.0:1784755911.668609:0:5776:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784755911.668614:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c32ca 00000100:00100000:1.0:1784755911.668836:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784755911.668937:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784755911.668948:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784755911.672493:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784755911.672505:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784755911.688241:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755911.688442:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784755911.688450:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784755911.693108:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784755911.693123:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784755911.693536:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784755911.693544:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784755911.702711:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755911.702717:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755911.702719:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755911.703219:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755911.703222:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755911.703223:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755911.703763:0:5776:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784755911.727930:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784755911.953088:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1863 MB/s 00000001:01000000:2.0:1784755912.202774:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2775 MB/s 00000001:01000000:3.0:1784755912.453371:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 671 MB/s 00000001:01000000:2.0:1784755912.710205:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 665 MB/s 00080000:10000000:1.0:1784755912.720364:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1784755912.737787:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784755912.738518:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784755912.738534:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784755912.738536:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784755912.742876:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784755912.743090:0:5776:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784755912.743158:0:5776:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1784755912.744044:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784755912.744161:0:5776:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784755912.745971:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755912.746138:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784755912.746145:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784755912.747167:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784755912.747176:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784755912.747612:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784755912.747619:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1784755912.767111:0:5792:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1784755912.767235:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784755912.767257:0:5776:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.108@tcp' 00000020:01000004:3.0:1784755912.767259:0:5776:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784755912.767316:0:5776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.108@tcp (typ=mgc) 00000020:00000080:3.0:1784755912.767348:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.108@tcp (000000000ef89a12) 00000020:00000080:3.0:1784755912.767367:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784755912.771116:0:5776:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000016f08526@MGC192.168.202.108@tcp: add connection 192.168.202.108@tcp at head 00010000:00010000:3.0:1784755912.771470:0:5776:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.108@tcp-0 is initialized 00000040:01000000:3.0:1784755912.771479:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.108@tcp ctxt 1 is initialized 10000000:01000000:1.0:1784755912.775535:0:5793:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784755912.775658:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.108@tcp (uuid 5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33) 00000020:00000080:3.0:1784755912.775682:0:5776:0:(genops.c:1406:class_connect()) connect: client 5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33, cookie 0x8f2fc1536a2c32d8 00000100:00080000:3.0:1784755912.775695:0:5776:0:(import.c:510:import_select_connection()) MGC192.168.202.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784755912.775700:0:5776:0:(import.c:624:import_select_connection()) MGC192.168.202.108@tcp: import 0000000016f08526 using connection 192.168.202.108@tcp/0@lo 00000100:00100000:3.0:1784755912.775766:0:5776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000012b21417 x1871452153315456/t0(0) o250->MGC192.168.202.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784755912.775788:0:5776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33->MGS 00000020:01000004:3.0:1784755912.775805:0:5776:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784755912.775810:0:5776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784755912.775824:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ad1bf03f) 00000020:00000080:3.0:1784755912.775836:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784755912.788505:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000012b21417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3313:1871452153315456:0@lo:250: 00000100:00100000:2.0:1784755912.788611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755912.788702:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153315456 00000100:00100000:2.0:1784755912.788709:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153315456 00000100:00100000:2.0:1784755912.788756:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755912.788762:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e4af075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1871452153315456:12345-0@lo:250: 00010000:00080000:2.0:1784755912.788786:0:5789:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1784755912.788814:0:5789:0:(genops.c:1406:class_connect()) connect: client 5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33, cookie 0x8f2fc1536a2c32e6 00000100:00080000:2.0:1784755912.788929:0:5789:0:(import.c:65:import_set_state_nolock()) 000000008f7e2351 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755912.791520:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e4af075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:3313:x1871452153315456:12345-0@lo:250: Request processed in 2748us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755912.791537:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755912.791631:0:3313:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784755912.791674:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.108@tcp: connect to target with instance 0 00000100:00080000:2.0:1784755912.791684:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784755912.791690:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784755912.791694:0:3313:0:(import.c:65:import_set_state_nolock()) 0000000016f08526 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784755912.791696:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784755912.791723:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784755912.791730:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000012b21417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3313:1871452153315456:0@lo:250: 00000100:00100000:3.0:1784755912.799531:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755912.799948:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784755912.799956:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784755912.801293:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784755912.801301:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784755912.802502:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784755912.802513:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784755912.804400:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755912.804613:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784755912.804627:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784755912.808037:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784755912.808049:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784755912.863794:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755912.863972:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784755912.863977:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784755912.865313:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784755912.865334:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784755912.866014:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755912.866367:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755912.866373:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784755912.868009:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755912.868021:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784755912.869382:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755912.869558:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755912.869564:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784755912.870614:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755912.870623:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784755912.871390:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755912.871541:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755912.871553:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784755912.873011:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755912.873020:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784755912.904919:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755912.905564:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784755912.905571:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784755912.907630:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784755912.907677:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784755912.908367:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784755912.908374:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784755912.910082:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784755912.910106:0:5776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784755912.910111:0:5776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784755912.910242:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784755912.910272:0:5776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.108@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784755912.910277:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784755912.910278:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784755912.910280:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784755912.910281:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784755912.910282:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784755912.910284:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784755912.910285:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784755912.910286:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784755912.910287:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784755912.910288:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784755912.910290:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784755912.910291:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784755912.910293:0:5776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784755912.910295:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784755912.910296:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784755912.910298:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784755912.910299:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784755912.910304:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784755912.910305:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784755912.910306:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784755912.910307:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784755912.910308:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784755912.910309:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784755912.910309:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784755912.910310:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784755912.910347:0:5776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784755912.910367:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5145c16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315584:0@lo:253: 00000100:00100000:3.0:1784755912.910444:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755912.910497:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a087c17 going to sleep for 11 seconds 00000100:00100000:0.0:1784755912.910593:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153315584 00000100:00100000:0.0:1784755912.910600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153315584 00000100:00100000:3.0:1784755912.910862:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755912.910871:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7344739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5776:x1871452153315584:12345-0@lo:253: 20000000:01000000:3.0:1784755912.910914:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784755912.910916:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1784755912.911220:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784755912.911273:0:5790:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1784755912.911604:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755912.916932:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1784755912.917272:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784755912.917276:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1784755912.917283:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1784755912.917286:0:5790:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1784755912.917302:0:5790:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1784755912.917617:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755912.918145:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1784755912.918158:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784755912.918205:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1784755912.918254:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1784755912.918294:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1784755912.918389:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1784755912.918397:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1784755912.918442:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1784755912.918450:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1784755912.918483:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1784755912.918569:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1784755912.918610:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1784755912.918864:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1784755912.918898:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784755912.918903:0:5790:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1784755912.918914:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755912.919150:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1784755912.919161:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784755912.919194:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1784755912.919227:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1784755912.919274:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1784755912.919285:0:5790:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1784755912.919368:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1784755912.919376:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784755912.919421:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1784755912.919458:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1784755912.919493:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1784755912.919568:0:5790:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1784755912.919930:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1784755912.919941:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1784755912.919976:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1784755912.920012:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1784755912.920390:0:5790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1784755912.920437:0:5790:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784755912.920445:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784755912.921074:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1784755912.921363:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1784755912.921382:0:5790:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.108@tcp for mdt 20000000:01000000:3.0:1784755912.921385:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.108@tcp (null) (null) (null) 00000040:00080000:3.0:1784755912.921418:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1784755912.921426:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784755912.921455:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1784755912.921462:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.108@tcp (null) (null) 00000040:00080000:3.0:1784755912.921581:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1784755912.921592:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784755912.921960:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1784755912.922002:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1784755912.922067:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784755912.922070:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784755912.922075:0:5790:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1784755912.922081:0:5790:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784755912.923046:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1784755912.923184:0:5790:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784755912.939290:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1784755912.939358:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1784755912.939449:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1784755912.939468:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784755912.939471:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784755912.939475:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784755912.939488:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784755912.939491:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784755912.939522:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784755912.939525:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784755912.940304:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1784755912.940621:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1784755912.940713:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1784755912.940904:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1784755912.940920:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784755912.940922:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784755912.941426:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1784755912.941708:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1784755912.941750:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1784755912.941793:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1784755912.941805:0:5790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755912.941808:0:5790:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1784755912.941813:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784755912.941832:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941848:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941866:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941872:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941878:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941885:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941891:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a00b0a74 already unused, calling callback (0000000015996f8e) 00010000:00010000:3.0:1784755912.941894:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941899:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941908:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941914:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755912.941917:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a00b0a74/0x8f2fc1536a2c32ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755912.941930:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784755913.290886:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7344739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5776:x1871452153315584:12345-0@lo:253: Request processed in 380008us (380434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755913.290909:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755913.291217:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5145c16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315584:0@lo:253: 10000000:01000000:2.0:1784755913.291232:0:5776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784755913.291235:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755913.291237:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755913.291238:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755913.291239:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784755913.291255:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755913.291256:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755913.291258:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755913.291259:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755913.291260:0:5776:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784755913.291262:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755913.291263:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784755913.291283:0:5776:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003914a3f8 from lustre-MDT0000 10000000:01000000:2.0:1784755913.291308:0:5776:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784755913.291311:0:5776:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784755913.291325:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fcf46313380 10000000:01000000:2.0:1784755913.291330:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784755913.291338:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8fcf46313380 from 1 10000000:01000000:2.0:1784755913.291341:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784755913.291395:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.291406:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.291567:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755913.291587:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315712:0@lo:101: 00000100:00100000:2.0:1784755913.291626:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.291709:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:0.0:1784755913.291797:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153315712 00000100:00100000:0.0:1784755913.291805:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153315712 00000100:00100000:0.0:1784755913.291870:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755913.291879:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017214d24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5776:x1871452153315712:12345-0@lo:101: 00010000:00010000:0.0:1784755913.291892:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755913.291907:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c281a4e/0x8f2fc1536a2c32fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c32f4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.291931:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c281a4e/0x8f2fc1536a2c32fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.291940:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c281a4e/0x8f2fc1536a2c32fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.291958:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c281a4e, rc 0) 00000100:00100000:0.0:1784755913.291999:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017214d24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+6:5776:x1871452153315712:12345-0@lo:101: Request processed in 122us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755913.292005:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755913.292139:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315712:0@lo:101: 00010000:00010000:2.0:1784755913.292151:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.292158:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755913.292222:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315840:0@lo:501: 00000100:00100000:2.0:1784755913.292246:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.292265:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:1.0:1784755913.292331:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153315840 00000100:00100000:1.0:1784755913.292337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153315840 00000100:00100000:1.0:1784755913.292371:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784755913.292377:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6170135 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+6:5776:x1871452153315840:12345-0@lo:501: 00000100:00100000:1.0:1784755913.292634:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6170135 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+6:5776:x1871452153315840:12345-0@lo:501: Request processed in 257us (387us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755913.292666:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755913.292840:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315840:0@lo:501: 10000000:01000000:2.0:1784755913.292882:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784755913.292899:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.292907:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 00000000f94255f9/0x8f2fc1536a2c32f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755913.292916:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fcf4549c800 10000000:01000000:2.0:1784755913.292920:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784755913.292924:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fcf4549c800 10000000:01000000:2.0:1784755913.292926:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784755913.292929:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8fcf4549c800 from 1 10000000:01000000:2.0:1784755913.292931:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784755913.292946:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.292952:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.292958:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755913.292970:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315968:0@lo:101: 00000100:00100000:2.0:1784755913.293003:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.293021:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:1.0:1784755913.293149:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153315968 00000100:00100000:1.0:1784755913.293154:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153315968 00000100:00100000:1.0:1784755913.293181:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755913.293186:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000773ed23e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+6:5776:x1871452153315968:12345-0@lo:101: 00010000:00010000:1.0:1784755913.293194:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755913.293209:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000623ed7e6/0x8f2fc1536a2c3309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3302 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755913.293223:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000623ed7e6/0x8f2fc1536a2c3309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3302 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755913.293230:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000623ed7e6/0x8f2fc1536a2c3309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3302 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755913.293236:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000623ed7e6, rc 0) 00000100:00100000:1.0:1784755913.293260:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000773ed23e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+7:5776:x1871452153315968:12345-0@lo:101: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755913.293265:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755913.293702:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153315968:0@lo:101: 00010000:00010000:2.0:1784755913.293713:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3309 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.293722:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3309 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755913.293734:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784755913.293747:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3309 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.293752:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 00000000471c36e2/0x8f2fc1536a2c3302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3309 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755913.293758:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784755913.293763:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784755913.293767:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fcf4549c800 10000000:01000000:2.0:1784755913.293770:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784755913.293774:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784755913.293776:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784755913.293790:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.293797:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.293804:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755913.293823:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316096:0@lo:101: 00000100:00100000:2.0:1784755913.293986:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.294016:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:0.0:1784755913.294071:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316096 00000100:00100000:0.0:1784755913.294076:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316096 00000100:00100000:0.0:1784755913.294113:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755913.294119:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a058de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+7:5776:x1871452153316096:12345-0@lo:101: 00010000:00010000:0.0:1784755913.294127:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755913.294137:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000374693d2/0x8f2fc1536a2c3317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3310 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.294151:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000374693d2/0x8f2fc1536a2c3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.294158:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000374693d2/0x8f2fc1536a2c3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755913.294164:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000374693d2, rc 0) 00000100:00100000:0.0:1784755913.294192:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a058de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+8:5776:x1871452153316096:12345-0@lo:101: Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755913.294197:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755913.294276:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316096:0@lo:101: 00010000:00010000:2.0:1784755913.294285:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755913.294292:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755913.294342:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316224:0@lo:501: 00000100:00100000:2.0:1784755913.294368:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.294389:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:0.0:1784755913.294498:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316224 00000100:00100000:0.0:1784755913.294502:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316224 00000100:00100000:0.0:1784755913.294531:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784755913.294537:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdafb012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+8:5776:x1871452153316224:12345-0@lo:501: 00000100:00100000:0.0:1784755913.301627:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdafb012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5776:x1871452153316224:12345-0@lo:501: Request processed in 7080us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755913.301676:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755913.302096:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316224:0@lo:501: 00000100:00100000:2.0:1784755913.302152:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316352:0@lo:503: 00000100:00100000:2.0:1784755913.302212:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755913.302260:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a128777b going to sleep for 11 seconds 00000100:00100000:0.0:1784755913.302353:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316352 00000100:00100000:0.0:1784755913.302360:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316352 00000100:00100000:0.0:1784755913.302405:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784755913.302412:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d705951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5776:x1871452153316352:12345-0@lo:503: 00000100:00100000:0.0:1784755913.303765:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d705951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5776:x1871452153316352:12345-0@lo:503: Request processed in 1351us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755913.303774:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784755913.303937:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d427e88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316352:0@lo:503: 00000100:00100000:3.0:1784755913.309755:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5820:1871452153316480:0@lo:502: 00000100:00100000:3.0:1784755913.309897:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755913.310045:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000560bd584 going to sleep for 11 seconds 00000100:00100000:2.0:1784755913.313131:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316480 00000100:00100000:2.0:1784755913.313146:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316480 00000100:00100000:2.0:1784755913.313204:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755913.313212:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003be4c10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5820:x1871452153316480:12345-0@lo:502: 00000100:00100000:2.0:1784755913.313672:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003be4c10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5820:x1871452153316480:12345-0@lo:502: Request processed in 422us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755913.313682:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784755913.314001:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5820:1871452153316480:0@lo:502: 00000020:01000000:3.0:1784755913.314038:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755913.314049:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755913.314052:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784755913.314057:0:5820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784755913.314060:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784755913.314074:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fa454f11) 00000020:00000080:3.0:1784755913.314091:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784755913.314098:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784755913.314168:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784755913.314175:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c3325 00000020:00000080:3.0:1784755913.314394:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784755913.314399:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755913.314402:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755913.314404:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784755913.314406:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755913.314409:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755913.314411:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784755913.314478:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784755913.314485:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d7e709bc) 00000020:00000080:3.0:1784755913.314495:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784755913.314499:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784755913.314501:0:5820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784755913.314504:0:5820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784755913.314509:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784755913.314552:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003914a3f8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784755913.314569:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ad7c9a73) 00000020:00000080:3.0:1784755913.314578:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784755913.314658:0:5820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784755913.314668:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f2fc1536a2c333a 00000020:00000080:3.0:1784755913.314784:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784755913.314790:0:5820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784755913.314795:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8f2fc1536a2c3341 00080000:01000000:3.0:1784755913.314800:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784755913.314803:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c3348 00080000:10000000:3.0:1784755913.315231:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1784755913.316160:0:5820:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1784755913.323302:0:5820:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784755913.479931:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784755913.480395:0:5820:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784755913.485094:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784755913.485518:0:5820:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784755913.567436:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000415fbccf) 00000020:00000080:1.0:1784755913.567460:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784755913.567538:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784755913.567545:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c3356 00000020:00000080:3.0:1784755913.568330:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784755913.571558:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755913.687341:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1784755913.770817:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784755913.786156:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755913.873852:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755913.947889:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755914.010035:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1784755914.047562:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8f2fc1536a2c335d 00000020:00000080:1.0:1784755914.047972:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784755914.047982:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755914.047988:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755914.047990:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784755914.047993:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755914.048000:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755914.048001:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784755914.048004:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784755914.048036:0:5820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784755914.048047:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755914.048055:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755914.048056:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784755914.048059:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755914.048061:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755914.048063:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784755914.048065:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784755914.048067:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784755914.048120:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5820:1871452153316608:0@lo:502: 00000100:00100000:1.0:1784755914.048304:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755914.048412:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000001cab4c71 going to sleep for 11 seconds 00000100:00100000:3.0:1784755914.051517:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316608 00000100:00100000:3.0:1784755914.051531:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316608 00000100:00100000:3.0:1784755914.051675:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784755914.051692:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f63bdaac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5820:x1871452153316608:12345-0@lo:502: 00000100:00100000:3.0:1784755914.052060:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f63bdaac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5820:x1871452153316608:12345-0@lo:502: Request processed in 370us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755914.052068:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784755914.052341:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5820:1871452153316608:0@lo:502: 00000020:01000000:1.0:1784755914.052375:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755914.052382:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755914.052385:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784755914.052403:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1784755914.052663:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1784755914.052696:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784755914.052712:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.052724:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 00000000827bde92/0x8f2fc1536a2c3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755914.052732:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8fcf4549c800 from 1 10000000:01000000:2.0:1784755914.052734:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784755914.052765:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.052773:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.052780:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755914.052798:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eeb33040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316736:0@lo:101: 00000100:00100000:2.0:1784755914.052838:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.053147:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7175888 going to sleep for 11 seconds 00000100:00100000:0.0:1784755914.053283:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316736 00000100:00100000:0.0:1784755914.053289:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316736 00000100:00100000:0.0:1784755914.053329:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784755914.053337:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000300ebfff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:5776:x1871452153316736:12345-0@lo:101: 00010000:00010000:0.0:1784755914.053349:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755914.053361:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3364 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.053382:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.053401:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.053510:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ca0cb0b, rc 0) 00000100:00100000:0.0:1784755914.053555:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000300ebfff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:5776:x1871452153316736:12345-0@lo:101: Request processed in 219us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.053561:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755914.053664:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eeb33040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316736:0@lo:101: 00010000:00010000:2.0:1784755914.053743:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.053753:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755914.054801:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eeb33040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316864:0@lo:256: 00000100:00100000:3.0:1784755914.054857:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755914.054936:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366514da going to sleep for 11 seconds 00000100:00100000:1.0:1784755914.054997:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316864 00000100:00100000:1.0:1784755914.055004:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316864 00000100:00100000:0.0:1784755914.055060:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784755914.055070:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a5c1c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:5776:x1871452153316864:12345-0@lo:256: 20000000:01000000:0.0:1784755914.055088:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784755914.055094:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784755914.055269:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eeb33040 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316864:0@lo:256: 10000000:01000000:3.0:1784755914.056058:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784755914.056085:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056106:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755914.056114:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf4549c800 from 1 10000000:01000000:3.0:1784755914.056117:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784755914.056146:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056154:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056162:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755914.056252:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316992:0@lo:101: 00000100:00100000:3.0:1784755914.056290:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755914.056319:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366514da going to sleep for 11 seconds 00000100:00100000:3.0:1784755914.056345:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153316992 00000100:00100000:3.0:1784755914.056350:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153316992 00000100:00100000:3.0:1784755914.056378:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755914.056490:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ae36dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153316992:12345-0@lo:101: 00010000:00010000:3.0:1784755914.056501:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755914.056514:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3372 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056536:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056544:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056558:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b32ff97, rc 0) 00000100:00100000:3.0:1784755914.056589:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ae36dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153316992:12345-0@lo:101: Request processed in 205us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755914.056595:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755914.056633:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153316992:0@lo:101: 00010000:00010000:3.0:1784755914.056669:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755914.056677:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755914.056791:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317120:0@lo:501: 00000100:00100000:3.0:1784755914.056818:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755914.056830:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000366514da going to sleep for 11 seconds 00000100:00100000:3.0:1784755914.056842:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317120 00000100:00100000:3.0:1784755914.056845:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317120 00000100:00100000:3.0:1784755914.056862:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784755914.056866:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee89776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317120:12345-0@lo:501: 00000100:00100000:0.0:1784755914.057270:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a5c1c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153316864:12345-0@lo:256: Request processed in 2202us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.057279:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755914.058053:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee89776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153317120:12345-0@lo:501: Request processed in 1185us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755914.058060:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755914.058128:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000358124d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317120:0@lo:501: 00000100:00100000:2.0:1784755914.058165:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317248:0@lo:503: 00000100:00100000:2.0:1784755914.058218:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.058422:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7175888 going to sleep for 11 seconds 00000100:00100000:0.0:1784755914.058579:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317248 00000100:00100000:0.0:1784755914.058586:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317248 00000100:00100000:0.0:1784755914.058616:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755914.058622:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a17a9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153317248:12345-0@lo:503: 00000040:00080000:0.0:1784755914.058697:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784755914.058745:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a17a9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153317248:12345-0@lo:503: Request processed in 123us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.058751:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755914.058893:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317248:0@lo:503: 00000040:00080000:0.0:1784755914.059816:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784755914.060068:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784755914.060087:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784755914.060106:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.060115:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755914.060153:0:5776:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784755914.060156:0:5776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fcf4549c800 10000000:01000000:2.0:1784755914.060159:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fcf4549c800 10000000:01000000:2.0:1784755914.060163:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784755914.060180:0:5776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf4549c800 from 1 10000000:01000000:2.0:1784755914.060182:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784755914.060207:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.060213:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.060222:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755914.060249:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317376:0@lo:101: 00000100:00100000:2.0:1784755914.060288:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.060350:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7175888 going to sleep for 11 seconds 00000100:00100000:0.0:1784755914.060706:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317376 00000100:00100000:0.0:1784755914.060712:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317376 00000100:00100000:0.0:1784755914.060741:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755914.060748:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ff1e625 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153317376:12345-0@lo:101: 00010000:00010000:0.0:1784755914.060758:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755914.060768:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079390ecb/0x8f2fc1536a2c3387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3380 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.060787:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079390ecb/0x8f2fc1536a2c3387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.060795:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079390ecb/0x8f2fc1536a2c3387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.060815:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079390ecb, rc 0) 00000100:00100000:0.0:1784755914.060849:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ff1e625 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317376:12345-0@lo:101: Request processed in 102us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.060855:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755914.061002:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317376:0@lo:101: 00010000:00010000:2.0:1784755914.061015:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.061024:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755914.061067:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317504:0@lo:501: 00000100:00100000:2.0:1784755914.061103:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.061127:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7175888 going to sleep for 11 seconds 00000100:00100000:0.0:1784755914.061331:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317504 00000100:00100000:0.0:1784755914.061335:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317504 00000100:00100000:0.0:1784755914.061353:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755914.061358:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c297ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317504:12345-0@lo:501: 00000100:00100000:0.0:1784755914.061601:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c297ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317504:12345-0@lo:501: Request processed in 242us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.061607:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784755914.061781:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317504:0@lo:501: 00000100:00100000:2.0:1784755914.061805:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317632:0@lo:503: 00000100:00100000:2.0:1784755914.061842:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.061862:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7175888 going to sleep for 11 seconds 00000100:00100000:0.0:1784755914.062057:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317632 00000100:00100000:0.0:1784755914.062062:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317632 00000100:00100000:0.0:1784755914.062079:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755914.062083:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c63e174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317632:12345-0@lo:503: 00000100:00100000:0.0:1784755914.062502:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c63e174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153317632:12345-0@lo:503: Request processed in 417us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755914.062509:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784755914.062631:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d235e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153317632:0@lo:503: 00000100:00100000:0.0:1784755914.063364:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992fe5a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5825:1871452153317760:0@lo:502: 00000100:00100000:0.0:1784755914.063429:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755914.063465:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000de79f6a2 going to sleep for 11 seconds 00000100:00100000:2.0:1784755914.063606:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317760 00000100:00100000:2.0:1784755914.063612:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317760 00000100:00100000:2.0:1784755914.063660:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784755914.063667:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c2cf3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5825:x1871452153317760:12345-0@lo:502: 00000100:00100000:2.0:1784755914.063887:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c2cf3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5825:x1871452153317760:12345-0@lo:502: Request processed in 221us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755914.063903:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755914.064146:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992fe5a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5825:1871452153317760:0@lo:502: 00000020:01000004:0.0:1784755914.064553:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784755914.064578:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f5c30f84) 00000020:00000080:0.0:1784755914.064598:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784755914.064812:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003914a3f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784755914.064816:0:5825:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003914a3f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784755914.064819:0:5825:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003914a3f8 4 00010000:00080000:0.0:1784755914.064859:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067c20a6e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.108@tcp at head 00010000:00010000:0.0:1784755914.070633:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784755914.070836:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784755914.071075:0:5825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784755914.071088:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8f2fc1536a2c3395 00000100:00080000:0.0:1784755914.071099:0:5825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784755914.071105:0:5825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067c20a6e using connection 192.168.202.108@tcp/0@lo 00000100:00100000:0.0:1784755914.071137:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000992fe5a4 x1871452153317888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784755914.071762:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784755914.072304:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992fe5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1871452153317888:0@lo:38: 00000100:00100000:2.0:1784755914.072508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755914.073024:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153317888 00000100:00100000:0.0:1784755914.073031:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153317888 00000100:00100000:0.0:1784755914.075068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755914.075077:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d235e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1871452153317888:12345-0@lo:38: 00000100:00100000:0.0:1784755914.075190:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d235e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1871452153317888:12345-0@lo:38: Request processed in 112us (2804us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784755914.075198:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755914.077049:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784755914.077062:0:3313:0:(import.c:65:import_set_state_nolock()) 0000000067c20a6e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784755914.077068:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784755914.077071:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992fe5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1871452153317888:0@lo:38: 00000100:00100000:1.0:1784755914.078719:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5825:1871452153318016:0@lo:502: 00000100:00100000:1.0:1784755914.078798:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755914.078836:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318016 00000100:00100000:1.0:1784755914.078842:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318016 00000100:00100000:1.0:1784755914.078885:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755914.078893:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d3e3637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5825:x1871452153318016:12345-0@lo:502: 00000100:00100000:1.0:1784755914.079096:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d3e3637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5825:x1871452153318016:12345-0@lo:502: Request processed in 204us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755914.079113:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755914.079238:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000001cab4c71 going to sleep for 11 seconds 00000100:00100000:1.0:1784755914.079256:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5825:1871452153318016:0@lo:502: 00000040:00080000:1.0:1784755914.079279:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784755914.083319:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784755914.083356:0:5776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784755914.083382:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.083555:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 0000000012132f2b/0x8f2fc1536a2c3380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784755914.083612:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784755914.083615:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755914.083616:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755914.083617:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755914.083618:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755914.083619:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755914.083621:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755914.083623:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755914.083624:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755914.083625:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755914.083627:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755914.083628:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784755914.083631:0:5776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784755914.083634:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784755914.083756:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755914.083758:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755914.083759:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755914.083760:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755914.083761:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755914.083762:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755914.083763:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755914.083764:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755914.083765:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755914.083772:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755914.083773:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784755914.083801:0:5776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784755914.083819:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006646f8b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153318144:0@lo:253: 00000100:00100000:2.0:1784755914.083902:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.083941:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set 000000001eb621ba going to sleep for 11 seconds 00000100:00100000:2.0:1784755914.083978:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318144 00000100:00100000:2.0:1784755914.083985:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318144 00000100:00100000:2.0:1784755914.084036:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784755914.084044:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc08e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5776:x1871452153318144:12345-0@lo:253: 20000000:01000000:2.0:1784755914.084068:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784755914.084082:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784755914.124603:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784755914.124740:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784755914.126752:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784755914.126760:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784755914.126779:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.126798:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.126807:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.126863:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.126876:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 12 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755914.126890:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007ce0f487 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153318272:0@lo:104: 00000100:00100000:0.0:1784755914.126950:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755914.127009:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020f4d943 going to sleep for 11 seconds 00000100:00100000:1.0:1784755914.127087:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318272 00000100:00100000:1.0:1784755914.127095:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318272 00000100:00100000:1.0:1784755914.127144:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755914.127152:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6151290 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153318272:12345-0@lo:104: 00010000:00010000:1.0:1784755914.127165:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755914.127338:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755914.127343:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6151290 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153318272:12345-0@lo:104: Request processed in 193us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755914.127350:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784755914.127402:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755914.127417:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.127424:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004be4605e already unused, calling callback (00000000daf6fa53) 10000000:00010000:2.0:1784755914.127427:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.127434:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755914.127440:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755914.127445:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755914.127480:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.127498:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755914.127512:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.127518:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: 000000004be4605e/0x8f2fc1536a2c3364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c336b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.127535:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755914.127537:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755914.127538:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755914.127692:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007ce0f487 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153318272:0@lo:104: 00010000:00010000:0.0:1784755914.127712:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755914.127772:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae709c4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153318400:0@lo:103: 00000100:00100000:0.0:1784755914.127801:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755914.127970:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318400 00000100:00100000:2.0:1784755914.127975:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318400 00010000:00010000:2.0:1784755914.127993:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755914.128012:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755914.128017:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ce0f487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3315:x1871452153318400:12345-0@lo:103: 00010000:00010000:2.0:1784755914.128027:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755914.128030:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128039:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128052:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008ca0cb0b/0x8f2fc1536a2c336b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3364 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128065:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128081:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784755914.128094:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001334381s 00010000:00010000:2.0:1784755914.128097:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128103:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128109:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128114:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128119:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b0e18baf already unused, calling callback (0000000015996f8e) 00010000:00010000:2.0:1784755914.128121:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128127:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128145:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755914.128154:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755914.128299:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ce0f487 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3315:x1871452153318400:12345-0@lo:103: Request processed in 282us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755914.128316:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755914.128376:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae709c4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153318400:0@lo:103: 00010000:00010000:0.0:1784755914.128421:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.128429:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755914.128434:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b0e18baf/0x8f2fc1536a2c339c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755914.133926:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc08e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5776:x1871452153318144:12345-0@lo:253: Request processed in 49874us (50017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755914.133943:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784755914.134524:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006646f8b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5776:1871452153318144:0@lo:253: 10000000:01000000:2.0:1784755914.134541:0:5776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784755914.134544:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755914.134546:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755914.134547:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755914.134548:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755914.134550:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755914.134551:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755914.134552:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755914.134554:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755914.134555:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755914.134556:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755914.134558:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755914.134560:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784755914.134573:0:5776:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784755914.146576:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.147079:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755914.147526:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.147740:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755914.152059:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.152514:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755914.153714:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.154095:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755914.154394:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.154665:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755914.155260:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755914.155538:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1784755914.208746:0:5776:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1784755914.239300:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784755914.239670:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784755914.242170:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784755914.242351:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784755914.242804:0:5776:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784755914.242812:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784755914.242942:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1784755914.243647:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784755914.243652:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1784755914.251354:0:5776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784755914.251915:0:5776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784755914.251948:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784755914.252550:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784755914.252927:0:5776:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1784755914.254262:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784755914.257859:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784755914.258053:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784755914.258215:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1784755914.258369:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784755914.259040:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1784755914.259189:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1784755914.259357:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784755914.259774:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1784755914.259939:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1784755914.260068:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1784755914.260214:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1784755914.260363:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1784755914.262033:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1784755914.262205:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1784755914.262374:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1784755914.262880:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1784755914.263032:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1784755914.263181:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1784755914.263351:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1784755914.263793:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1784755914.263944:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1784755914.264087:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1784755914.264235:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1784755914.264387:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1784755914.264618:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1784755914.264802:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1784755914.264966:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1784755914.265102:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1784755914.265242:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1784755914.265403:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1784755914.266188:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1784755914.266393:0:5776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1784755914.300276:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1784755914.357580:0:5776:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784755914.357610:0:5776:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d8b018db988 00100000:10000000:0.0:1784755914.357616:0:5776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784755914.358884:0:5776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784755914.358901:0:5776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784755914.358918:0:5776:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784755914.358948:0:5776:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1784755914.365923:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784755914.365995:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784755914.365999:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1784755914.784997:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755915.813685:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755916.830919:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755917.855866:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784755917.979108:0:6073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1784755918.174804:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784755918.174812:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8fcf4549c800 from 3 10000000:01000000:1.0:1784755918.174817:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784755918.174856:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755918.174867:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755918.174878:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755918.174902:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153318528:0@lo:101: 00000100:00100000:1.0:1784755918.175014:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755918.175104:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2fc4e63 going to sleep for 11 seconds 00000100:00100000:2.0:1784755918.176692:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318528 00000100:00100000:2.0:1784755918.176702:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318528 00000100:00100000:2.0:1784755918.176761:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784755918.176770:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b512448a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5793:x1871452153318528:12345-0@lo:101: 00010000:00010000:2.0:1784755918.176786:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755918.176802:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036775795/0x8f2fc1536a2c33aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c33a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755918.176827:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036775795/0x8f2fc1536a2c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755918.176837:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036775795/0x8f2fc1536a2c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755918.176845:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036775795, rc 0) 00000100:00100000:2.0:1784755918.176928:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b512448a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153318528:12345-0@lo:101: Request processed in 159us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755918.176935:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755918.180553:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2c0b51f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153318528:0@lo:101: 00010000:00010000:3.0:1784755918.180580:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755918.180591:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755918.180670:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003320f1c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153318656:0@lo:256: 00000100:00100000:3.0:1784755918.180730:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755918.180767:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318656 00000100:00100000:2.0:1784755918.180775:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318656 00000100:00100000:3.0:1784755918.180778:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000009814b190 going to sleep for 11 seconds 00000100:00100000:2.0:1784755918.180820:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784755918.180829:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f05d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153318656:12345-0@lo:256: 20000000:01000000:2.0:1784755918.180848:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784755918.180873:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784755918.180876:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1784755918.181440:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f05d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153318656:12345-0@lo:256: Request processed in 611us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755918.181451:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003320f1c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153318656:0@lo:256: 00000100:00100000:2.0:1784755918.181464:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:01000000:3.0:1784755918.181499:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784755918.181505:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755918.181513:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: 0000000067078b71/0x8f2fc1536a2c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755918.880050:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784755919.136781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784755919.136835:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784755919.136838:0:36:0:(import.c:65:import_set_state_nolock()) 0000000067c20a6e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784755919.136851:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067c20a6e using connection 192.168.202.108@tcp/0@lo 00000100:00100000:0.0:1784755919.136855:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003320f1c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153318784:0@lo:400: 00000100:00100000:3.0:1784755919.136874:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008d69adf5 x1871452153318912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784755919.136921:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755919.136945:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008d69adf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1871452153318912:0@lo:38: 00000100:00100000:1.0:1784755919.136980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755919.137074:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318784 00000100:00100000:3.0:1784755919.137082:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318784 00000100:00100000:3.0:1784755919.137223:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784755919.137231:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a1c948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3316:x1871452153318784:12345-0@lo:400: 00000100:00100000:3.0:1784755919.137303:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a1c948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3316:x1871452153318784:12345-0@lo:400: Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755919.137311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784755919.137334:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003320f1c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153318784:0@lo:400: 00000100:00100000:3.0:1784755919.137350:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153318912 00000100:00100000:3.0:1784755919.137355:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153318912 00000100:00100000:3.0:1784755919.137378:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755919.137388:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b75e5f3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1871452153318912:12345-0@lo:38: 00010000:00080000:3.0:1784755919.137406:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1784755919.137437:0:5798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8f2fc1536a2c33b1 00000004:00100000:3.0:1784755919.137471:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784755919.137568:0:5798:0:(import.c:65:import_set_state_nolock()) 00000000f4594f45 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784755919.137611:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b75e5f3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1871452153318912:12345-0@lo:38: Request processed in 228us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755919.137617:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784755919.138047:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008d69adf5 x1871452153318912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784755919.138060:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784755919.138066:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784755919.138070:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784755919.138072:0:3313:0:(import.c:65:import_set_state_nolock()) 0000000067c20a6e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784755919.138077:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008d69adf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1871452153318912:0@lo:38: 00010000:00010000:1.0:1784755919.902828:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755920.928156:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784755921.779620:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde832c260 20000000:00000080:2.0:1784755921.779820:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fcf7b3c0800 uarg=0000000000000000 20000000:01000000:2.0:1784755921.779854:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784755921.779861:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784755921.779865:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784755921.780065:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1784755921.780076:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784755921.784320:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755921.785568:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784755921.786277:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784755921.786346:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784755921.786367:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784755921.786385:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.786404:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.786410:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.786449:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.786463:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 11 pid: 5789 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755921.786478:0:6275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001980562e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1871452153319040:0@lo:104: 00000100:00100000:3.0:1784755921.786541:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755921.786599:0:6275:0:(client.c:2702:ptlrpc_set_wait()) set 000000006f622030 going to sleep for 11 seconds 00000100:00100000:1.0:1784755921.786765:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319040 00000100:00100000:1.0:1784755921.786773:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319040 00000100:00100000:1.0:1784755921.786824:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755921.786832:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac0d3ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:6275:x1871452153319040:12345-0@lo:104: 00010000:00010000:1.0:1784755921.786844:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.786895:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755921.786900:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac0d3ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:6275:x1871452153319040:12345-0@lo:104: Request processed in 69us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755921.786906:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784755921.786927:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755921.786931:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.786939:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8c98cd9 already unused, calling callback (00000000daf6fa53) 10000000:00010000:1.0:1784755921.786941:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.786948:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755921.786954:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755921.786959:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784755921.786985:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.786991:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755921.787014:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.787020:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: 00000000e8c98cd9/0x8f2fc1536a2c3372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3379 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755921.787034:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755921.787036:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755921.787037:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755921.787050:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784755921.787059:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bace5677 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153319168:0@lo:103: 00000100:00100000:1.0:1784755921.787087:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755921.787631:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319168 00000100:00100000:0.0:1784755921.787657:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319168 00000100:00100000:3.0:1784755921.788252:0:6275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001980562e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1871452153319040:0@lo:104: 00010000:00010000:3.0:1784755921.788272:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788311:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755921.788364:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755921.788370:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad9b26b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3316:x1871452153319168:12345-0@lo:103: 00010000:00010000:0.0:1784755921.788379:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755921.788382:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788389:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788398:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b32ff97/0x8f2fc1536a2c3379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3372 expref: 12 pid: 5789 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788408:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788412:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788420:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788432:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788436:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788439:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788442:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012a024cc already unused, calling callback (0000000015996f8e) 00010000:00010000:0.0:1784755921.788444:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788448:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788460:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755921.788465:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755921.788500:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad9b26b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:3316:x1871452153319168:12345-0@lo:103: Request processed in 132us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755921.788504:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1784755921.788539:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.788544:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755921.788548:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012a024cc/0x8f2fc1536a2c33b8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755921.788768:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bace5677 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153319168:0@lo:103: 00010000:00010000:1.0:1784755921.952914:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755922.975074:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755924.000711:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755924.254924:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153319424:0@lo:400: 00000100:00100000:0.0:1784755924.254993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755924.255049:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755924.255055:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c21502cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153319296:0@lo:400: 00000100:00100000:0.0:1784755924.255080:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755924.255111:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319424 00000100:00100000:0.0:1784755924.255128:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319424 00000100:00100000:0.0:1784755924.255169:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755924.255176:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1debd5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153319424:12345-0@lo:400: 00000100:00100000:0.0:1784755924.255232:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1debd5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153319424:12345-0@lo:400: Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755924.255238:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755924.255258:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319296 00000100:00100000:0.0:1784755924.255262:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319296 00000100:00100000:0.0:1784755924.255284:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784755924.255289:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7f5668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:3315:x1871452153319296:12345-0@lo:400: 00000100:00100000:0.0:1784755924.255327:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7f5668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:3315:x1871452153319296:12345-0@lo:400: Request processed in 38us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755924.255333:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784755924.255373:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c21502cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153319296:0@lo:400: 00010000:00080000:0.0:1784755924.255384:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e371f153 x1871452153319424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755924.255394:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153319424:0@lo:400: 00010000:00010000:2.0:1784755925.023446:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784755925.218305:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784755925.218313:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf4549c800 from 1 10000000:01000000:0.0:1784755925.218318:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784755925.218370:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: 00000000338eb409/0x8f2fc1536a2c33bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218383:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: 00000000338eb409/0x8f2fc1536a2c33bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218393:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: 00000000338eb409/0x8f2fc1536a2c33bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755925.218437:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319552:0@lo:101: 00000100:00100000:0.0:1784755925.218509:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755925.218557:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000643237fb going to sleep for 11 seconds 00000100:00100000:0.0:1784755925.218580:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319552 00000100:00100000:0.0:1784755925.218587:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319552 00000100:00100000:0.0:1784755925.218634:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784755925.218658:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e430bc67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:5793:x1871452153319552:12345-0@lo:101: 00010000:00010000:0.0:1784755925.218671:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755925.218683:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c308da4/0x8f2fc1536a2c33c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c33bf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218704:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c308da4/0x8f2fc1536a2c33c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218713:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c308da4/0x8f2fc1536a2c33c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218722:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c308da4, rc 0) 00000100:00100000:0.0:1784755925.218759:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e430bc67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153319552:12345-0@lo:101: Request processed in 103us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755925.218765:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784755925.218820:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319552:0@lo:101: 00010000:00010000:0.0:1784755925.218832:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: 00000000338eb409/0x8f2fc1536a2c33bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755925.218841:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: 00000000338eb409/0x8f2fc1536a2c33bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755925.218902:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319680:0@lo:501: 00000100:00100000:0.0:1784755925.218929:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755925.218942:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000643237fb going to sleep for 11 seconds 00000100:00100000:0.0:1784755925.218955:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319680 00000100:00100000:0.0:1784755925.218957:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319680 00000100:00100000:0.0:1784755925.218977:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755925.218982:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000361c69d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153319680:12345-0@lo:501: 00000100:00100000:0.0:1784755925.219255:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000361c69d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153319680:12345-0@lo:501: Request processed in 272us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755925.219263:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755925.219293:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319680:0@lo:501: 00000100:00100000:0.0:1784755925.219319:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319808:0@lo:503: 00000100:00100000:0.0:1784755925.219355:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755925.219367:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000643237fb going to sleep for 11 seconds 00000100:00100000:0.0:1784755925.219378:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319808 00000100:00100000:0.0:1784755925.219381:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319808 00000100:00100000:0.0:1784755925.219399:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784755925.219403:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d859a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153319808:12345-0@lo:503: 00000100:00100000:0.0:1784755925.219539:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d859a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153319808:12345-0@lo:503: Request processed in 135us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755925.219545:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784755925.219577:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e371f153 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153319808:0@lo:503: 00000100:00100000:3.0:1784755925.222927:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001980562e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6526:1871452153319936:0@lo:502: 00000100:00100000:3.0:1784755925.223005:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755925.223046:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075851b31 going to sleep for 11 seconds 00000100:00100000:0.0:1784755925.223097:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153319936 00000100:00100000:0.0:1784755925.223105:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153319936 00000100:00100000:0.0:1784755925.223161:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784755925.223169:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b16ea1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6526:x1871452153319936:12345-0@lo:502: 00000100:00100000:0.0:1784755925.223695:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b16ea1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6526:x1871452153319936:12345-0@lo:502: Request processed in 526us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755925.223704:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784755925.223919:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001980562e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6526:1871452153319936:0@lo:502: 00000020:01000000:3.0:1784755925.223950:0:6526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755925.223960:0:6526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755925.223962:0:6526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784755925.223971:0:6526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fcf4549c800 00000020:00000080:3.0:1784755925.223974:0:6526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784755925.224017:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6526:1871452153320064:0@lo:502: 00000100:00100000:3.0:1784755925.224055:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755925.224075:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4289fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755925.224126:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320064 00000100:00100000:0.0:1784755925.224131:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320064 00000100:00100000:0.0:1784755925.224166:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784755925.224173:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6526:x1871452153320064:12345-0@lo:502: 00000100:00100000:0.0:1784755925.224414:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6526:x1871452153320064:12345-0@lo:502: Request processed in 241us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755925.224421:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784755925.225082:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6526:1871452153320064:0@lo:502: 00000020:01000000:3.0:1784755925.225108:0:6526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755925.225114:0:6526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755925.225115:0:6526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784755925.225120:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784755925.226769:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784755925.226804:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784755925.226816:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755925.226828:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.047236:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784755926.463533:0:6587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784755926.463538:0:6587:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784755926.463695:0:6587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8fcf463c1000 00000020:01000004:0.0:1784755926.463712:0:6587:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784755926.463724:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784755926.463737:0:6587:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fcf7b9e3380) 00000020:00000080:0.0:1784755926.463754:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784755926.497229:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784755926.504361:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784755926.534564:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784755926.549561:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784755926.549604:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784755926.549685:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784755926.549711:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784755926.550062:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784755926.550073:0:6587:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784755926.550090:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f2fc1536a2c33d4 00000020:01000004:2.0:1784755926.550098:0:6587:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784755926.550127:0:6587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784755926.550131:0:6587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784755926.550137:0:6587:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784755926.550141:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784755926.550161:0:6587:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fcf7b494d40) 00000020:00000080:2.0:1784755926.550173:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784755926.552766:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755926.553104:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784755926.553110:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784755926.553860:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784755926.553868:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784755926.555537:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784755926.555546:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784755926.562257:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755926.562431:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784755926.562438:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784755926.565871:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784755926.565886:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784755926.611401:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755926.611903:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784755926.611919:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784755926.615169:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784755926.615183:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784755926.616179:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784755926.616187:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784755926.618422:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755926.618585:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784755926.618591:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784755926.622438:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784755926.622460:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784755926.706241:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755926.706440:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784755926.706446:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784755926.709425:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784755926.709440:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784755926.710169:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784755926.710204:0:6587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784755926.710215:0:6587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784755926.747153:0:6587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.108@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784755926.747188:0:6587:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.108@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784755926.747204:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784755926.747206:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784755926.747208:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755926.747209:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755926.747210:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755926.747211:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755926.747212:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755926.747214:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755926.747215:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755926.747217:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755926.747218:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784755926.747221:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784755926.747228:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784755926.747229:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784755926.747230:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755926.747231:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755926.747231:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755926.747232:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755926.747233:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755926.747234:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755926.747234:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755926.747235:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755926.747236:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784755926.747261:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784755926.747278:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153320192:0@lo:253: 00000100:00100000:2.0:1784755926.748004:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755926.755617:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf43289480 going to sleep for 11 seconds 00000100:00100000:3.0:1784755926.756085:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320192 00000100:00100000:3.0:1784755926.756094:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320192 00000100:00100000:3.0:1784755926.756154:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784755926.756165:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153320192:12345-0@lo:253: 20000000:01000000:3.0:1784755926.756209:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784755926.756214:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784755926.756221:0:5789:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784755926.756225:0:5789:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784755926.757421:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755926.758139:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784755926.758157:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784755926.758213:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1784755926.758222:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784755926.758254:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1784755926.758306:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784755926.759986:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784755926.760012:0:5789:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.108@tcp 20000000:01000000:3.0:1784755926.760014:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.108@tcp (null) (null) (null) 00000040:00080000:3.0:1784755926.760043:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784755926.760049:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784755926.760087:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784755926.760094:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.108@tcp (null) (null) 00000040:00080000:3.0:1784755926.760118:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784755926.760125:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784755926.760148:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784755926.760184:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784755926.763007:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784755926.763042:0:5789:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.108@tcp 20000000:01000000:3.0:1784755926.763045:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.108@tcp (null) (null) (null) 00000040:00080000:3.0:1784755926.763083:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784755926.763097:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784755926.763131:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784755926.763139:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.108@tcp (null) (null) 00000040:00080000:3.0:1784755926.763184:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784755926.763204:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784755926.763238:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784755926.763270:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784755926.763286:0:5789:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784755926.763289:0:5789:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784755926.763293:0:5789:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784755926.763304:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784755926.763307:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784755926.763338:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784755926.763341:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784755926.770387:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1784755926.770794:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1784755926.770956:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1784755926.771035:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1784755926.771049:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784755926.771059:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784755926.773004:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1784755926.773077:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1784755926.773124:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784755926.773486:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1784755926.773528:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1784755926.773563:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1784755926.773576:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784755926.773579:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784755926.774379:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1784755926.774438:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1784755926.774483:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1784755926.774933:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1784755926.774983:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1784755926.775041:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1784755926.775057:0:5789:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1784755926.775059:0:5789:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1784755926.775068:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784755926.775087:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775105:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775114:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775121:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775141:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775178:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775191:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.775217:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320320:0@lo:104: 00000100:00100000:3.0:1784755926.775276:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755926.775326:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775335:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 12 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.775343:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320448:0@lo:104: 00000100:00100000:3.0:1784755926.775365:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755926.775494:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.775503:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 12 pid: 5789 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.775511:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320576:0@lo:104: 00000100:00100000:3.0:1784755926.775533:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.781079:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1784755926.783980:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320320 00000100:00100000:2.0:1784755926.783995:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320320 00000100:00100000:2.0:1784755926.784053:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320448 00000100:00100000:2.0:1784755926.784057:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320448 00000100:00100000:2.0:1784755926.784068:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320576 00000100:00100000:2.0:1784755926.784070:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320576 00000100:00100000:2.0:1784755926.784085:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755926.784094:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5789:x1871452153320320:12345-0@lo:104: 00010000:00010000:2.0:1784755926.784110:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.784276:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755926.784282:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5789:x1871452153320320:12345-0@lo:104: Request processed in 190us (9006us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.784290:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755926.784307:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755926.784313:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:5789:x1871452153320448:12345-0@lo:104: 00010000:00010000:2.0:1784755926.784321:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.784372:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784755926.784377:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:5789:x1871452153320448:12345-0@lo:104: Request processed in 65us (9012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.784383:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755926.784395:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755926.784401:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5789:x1871452153320576:12345-0@lo:104: 00010000:00010000:2.0:1784755926.784408:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.784435:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784755926.784439:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5789:x1871452153320576:12345-0@lo:104: Request processed in 39us (8907us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.784445:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784755926.784529:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784755926.784537:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784545:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74138a00 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755926.784549:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784557:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755926.784564:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755926.784569:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755926.784609:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784615:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755926.784667:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784674:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74138a00/0x8f2fc1536a2c3380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3387 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784817:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784755926.784821:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784892:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74138200 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755926.784895:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784901:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755926.784907:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755926.784913:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755926.784928:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784934:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755926.784940:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784947:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74138200/0x8f2fc1536a2c3310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3317 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784956:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755926.784958:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784973:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74138600 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755926.784976:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.784983:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755926.784989:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755926.784994:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755926.785007:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785013:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755926.785028:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785035:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74138600/0x8f2fc1536a2c32f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c32fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785050:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755926.785051:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755926.785053:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755926.785061:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755926.785073:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153320704:0@lo:103: 00000100:00100000:0.0:1784755926.785112:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.785151:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784755926.785156:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153320832:0@lo:103: 00000100:00100000:0.0:1784755926.785185:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.785224:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153320960:0@lo:103: 00000100:00100000:0.0:1784755926.785247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.785280:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320704 00000100:00100000:0.0:1784755926.785285:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320704 00010000:00010000:0.0:1784755926.785308:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 13 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.785325:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320832 00000100:00100000:0.0:1784755926.785328:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320832 00010000:00010000:0.0:1784755926.785338:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.785348:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153320960 00000100:00100000:0.0:1784755926.785350:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153320960 00010000:00010000:0.0:1784755926.785359:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 15 pid: 5789 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.785371:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755926.785378:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:3316:x1871452153320704:12345-0@lo:103: 00010000:00010000:0.0:1784755926.785388:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755926.785393:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 15 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785404:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 15 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785420:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755926.785448:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:3316:x1871452153320704:12345-0@lo:103: Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.785463:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755926.785478:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784755926.785483:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:3316:x1871452153320832:12345-0@lo:103: 00010000:00010000:0.0:1784755926.785490:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755926.785494:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785502:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785511:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755926.785532:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:3316:x1871452153320832:12345-0@lo:103: Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.785538:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784755926.785549:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784755926.785555:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3314:x1871452153320960:12345-0@lo:103: 00010000:00010000:0.0:1784755926.785563:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755926.785567:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 13 pid: 5789 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785575:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 13 pid: 5789 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785587:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785596:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785621:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785628:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785634:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785662:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785667:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74011c00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784755926.785671:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.785678:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.787388:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.787405:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755926.787592:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3314:x1871452153320960:12345-0@lo:103: Request processed in 2035us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.787601:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784755926.788326:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153320832:0@lo:103: 00000100:00100000:0.0:1784755926.788341:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153320704:0@lo:103: 00010000:00010000:3.0:1784755926.788628:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3380 expref: 12 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.788676:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320320:0@lo:104: 00010000:00010000:3.0:1784755926.788704:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3310 expref: 11 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.788712:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320448:0@lo:104: 00010000:00010000:3.0:1784755926.788722:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030400/0x8f2fc1536a2c32fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c32f4 expref: 10 pid: 5789 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.788730:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1871452153320576:0@lo:104: 00010000:00010000:3.0:1784755926.788746:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.788754:0:5789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.788761:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.788767:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755926.788782:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784755926.796672:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153320960:0@lo:103: 00000100:00100000:2.0:1784755926.880759:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:6587:x1871452153320192:12345-0@lo:253: Request processed in 124587us (132748us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.880775:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784755926.888493:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153320192:0@lo:253: 10000000:01000000:1.0:1784755926.888515:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784755926.888519:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784755926.888520:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784755926.888522:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755926.888523:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784755926.888525:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755926.888526:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755926.888527:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755926.888555:0:6587:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784755926.888557:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755926.888558:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784755926.888584:0:6587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fcf463c1000 from lustre-OST0000 10000000:01000000:1.0:1784755926.888613:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784755926.888616:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784755926.888624:0:6587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fcf46313380 local copy 10000000:01000000:1.0:1784755926.888628:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784755926.888686:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.888698:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.888707:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755926.888724:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321088:0@lo:101: 00000100:00100000:1.0:1784755926.890541:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755926.890612:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf48843900 going to sleep for 11 seconds 00000100:00100000:3.0:1784755926.891094:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321088 00000100:00100000:3.0:1784755926.891104:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321088 00000100:00100000:3.0:1784755926.891157:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784755926.891166:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:6587:x1871452153321088:12345-0@lo:101: 00010000:00010000:3.0:1784755926.891180:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755926.891228:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c33e9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.891270:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33e9 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.891281:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33e9 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.891290:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011c00, rc 0) 00000100:00100000:3.0:1784755926.891360:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:6587:x1871452153321088:12345-0@lo:101: Request processed in 196us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755926.891367:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784755926.891404:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321088:0@lo:101: 00010000:00010000:2.0:1784755926.891423:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.891433:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755926.891575:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321216:0@lo:501: 00000100:00100000:2.0:1784755926.891610:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755926.891671:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1784755926.891733:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321216 00000100:00100000:3.0:1784755926.891738:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321216 00000100:00100000:3.0:1784755926.891760:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784755926.891766:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:6587:x1871452153321216:12345-0@lo:501: 00000100:00100000:3.0:1784755926.891982:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:6587:x1871452153321216:12345-0@lo:501: Request processed in 214us (370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784755926.891990:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784755926.892174:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321216:0@lo:501: 10000000:01000000:2.0:1784755926.892191:0:6587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784755926.892229:0:6587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784755926.892236:0:6587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892244:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892250:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892275:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784755926.892307:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fcf463c1000 10000000:01000000:2.0:1784755926.892312:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784755926.892317:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fcf46313380 10000000:01000000:2.0:1784755926.892319:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784755926.892322:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8fcf46313380 from 1 10000000:01000000:2.0:1784755926.892325:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784755926.892345:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892353:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892360:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755926.892374:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321344:0@lo:101: 00000100:00100000:2.0:1784755926.892401:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755926.892526:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604c4300 going to sleep for 11 seconds 00010000:00010000:1.0:1784755926.892535:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755926.892541:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.892549:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82150000 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755926.892553:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.892561:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755926.892568:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755926.892581:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755926.892600:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.892606:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755926.892657:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.892665:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82150000/0x8f2fc1536a2c33e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c33f0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.892680:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755926.892681:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755926.892683:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755926.892690:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784755926.892700:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153321472:0@lo:103: 00000100:00100000:1.0:1784755926.892728:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755926.892875:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321472 00000100:00100000:2.0:1784755926.892881:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321472 00000100:00100000:2.0:1784755926.892924:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755926.892933:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:3314:x1871452153321472:12345-0@lo:103: 00010000:00010000:2.0:1784755926.892946:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755926.892959:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c33f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f2fc1536a2c33e9 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.892973:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755926.893004:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:3314:x1871452153321472:12345-0@lo:103: Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.893011:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755926.893039:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153321472:0@lo:103: 00000100:00100000:3.0:1784755926.897586:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321344 00000100:00100000:3.0:1784755926.897600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321344 00000100:00100000:1.0:1784755926.899265:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784755926.899279:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+9:6587:x1871452153321344:12345-0@lo:101: 00010000:00010000:1.0:1784755926.899304:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755926.899327:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82150600/0x8f2fc1536a2c33fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c33f7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.899357:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82150600/0x8f2fc1536a2c33fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33f7 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.899368:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82150600/0x8f2fc1536a2c33fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33f7 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.899396:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82150600, rc 0) 00000100:00100000:1.0:1784755926.899527:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:6587:x1871452153321344:12345-0@lo:101: Request processed in 250us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.899543:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784755926.900243:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321344:0@lo:101: 00010000:00010000:0.0:1784755926.900275:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33fe expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.900285:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c33fe expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755926.900378:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784755926.900435:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33fe expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.900443:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43270600/0x8f2fc1536a2c33f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c33fe expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755926.900452:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784755926.900458:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784755926.900464:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784755926.900466:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784755926.900499:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.900507:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.900515:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.900544:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321600:0@lo:101: 00000100:00100000:0.0:1784755926.900585:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.900622:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf603670c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755926.901091:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321600 00000100:00100000:3.0:1784755926.901098:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321600 00000100:00100000:3.0:1784755926.901139:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784755926.901147:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+10:6587:x1871452153321600:12345-0@lo:101: 00010000:00010000:3.0:1784755926.901157:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755926.901170:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3405 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.901200:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.901221:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.901230:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74010800, rc 0) 00000100:00100000:3.0:1784755926.901274:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321600:12345-0@lo:101: Request processed in 127us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755926.901280:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784755926.901449:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321600:0@lo:101: 00010000:00010000:0.0:1784755926.901470:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.901478:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.901588:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321728:0@lo:501: 00000100:00100000:0.0:1784755926.901618:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.901900:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf603670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.901918:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321728 00000100:00100000:0.0:1784755926.901922:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321728 00000100:00100000:0.0:1784755926.901945:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784755926.901952:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321728:12345-0@lo:501: 00000100:00100000:0.0:1784755926.902230:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321728:12345-0@lo:501: Request processed in 277us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.902238:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784755926.902281:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321728:0@lo:501: 00000100:00100000:0.0:1784755926.902433:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321856:0@lo:503: 00000100:00100000:0.0:1784755926.902473:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.902487:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf603670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.902499:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321856 00000100:00100000:0.0:1784755926.902501:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321856 00000100:00100000:0.0:1784755926.902517:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784755926.902523:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321856:12345-0@lo:503: 00000100:00100000:0.0:1784755926.903010:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321856:12345-0@lo:503: Request processed in 486us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.903017:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784755926.903247:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321856:0@lo:503: 00000040:00080000:3.0:1784755926.903879:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755926.903947:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321984:0@lo:502: 00000100:00100000:3.0:1784755926.903998:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.904025:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.904153:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153321984 00000100:00100000:0.0:1784755926.904158:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153321984 00000100:00100000:0.0:1784755926.904239:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784755926.904248:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321984:12345-0@lo:502: 00000100:00100000:0.0:1784755926.904424:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153321984:12345-0@lo:502: Request processed in 176us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.904432:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784755926.905029:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153321984:0@lo:502: 00000040:00080000:3.0:1784755926.905315:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784755926.905366:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784755926.905401:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784755926.905462:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784755926.905502:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784755926.905545:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784755926.905575:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322112:0@lo:502: 00000100:00100000:3.0:1784755926.905621:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.906076:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.906186:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322112 00000100:00100000:1.0:1784755926.906202:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322112 00000100:00100000:1.0:1784755926.906238:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784755926.906245:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153322112:12345-0@lo:502: 00000100:00100000:1.0:1784755926.906480:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153322112:12345-0@lo:502: Request processed in 235us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.906487:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784755926.906623:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322112:0@lo:502: 00000040:00080000:3.0:1784755926.906733:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784755926.906744:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1784755926.907496:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784755926.907504:0:6606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1784755926.907510:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755926.907512:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784755926.907519:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784755926.907609:0:6606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fcf49098000) 00000020:00000080:1.0:1784755926.907631:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784755926.907850:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784755926.907916:0:6606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fcf463c1000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1784755926.907923:0:6606:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784755926.907930:0:6606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f2fc1536a2c341a 00010000:00010000:0.0:1784755926.913852:0:6606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1784755926.914252:0:6606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1784755926.917524:0:6606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1784755926.917883:0:6606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1784755926.933352:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1784755926.933992:0:6606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784755926.935720:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784755926.935734:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755926.935741:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755926.935743:0:6606:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784755926.935746:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755926.935749:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755926.935751:0:6606:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784755926.935754:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784755926.935756:0:6606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784755926.935910:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755926.935914:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755926.935915:0:6606:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784755926.935919:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784755926.936139:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784755926.936170:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784755926.936202:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.936213:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755926.936221:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf463c1000 from 1 10000000:01000000:3.0:1784755926.936224:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784755926.936261:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.936268:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.936278:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.936413:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322240:0@lo:101: 00000100:00100000:3.0:1784755926.936487:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.936580:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.936629:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322240 00000100:00100000:0.0:1784755926.936671:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322240 00000100:00100000:0.0:1784755926.936712:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784755926.936720:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:6587:x1871452153322240:12345-0@lo:101: 00010000:00010000:0.0:1784755926.936732:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755926.936742:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3421 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.936764:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.936784:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.936792:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030200, rc 0) 00000100:00100000:0.0:1784755926.936831:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322240:12345-0@lo:101: Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.936837:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784755926.940210:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322240:0@lo:101: 00010000:00010000:2.0:1784755926.940242:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.940255:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.941363:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322368:0@lo:501: 00000100:00100000:3.0:1784755926.941429:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.941520:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1784755926.941617:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322368 00000100:00100000:2.0:1784755926.941624:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322368 00000100:00100000:2.0:1784755926.941704:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784755926.941713:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322368:12345-0@lo:501: 00000100:00100000:2.0:1784755926.942176:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322368:12345-0@lo:501: Request processed in 462us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755926.942184:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784755926.946006:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322368:0@lo:501: 00000100:00100000:3.0:1784755926.946088:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322496:0@lo:503: 00000100:00100000:3.0:1784755926.946164:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.946223:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.946296:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322496 00000100:00100000:1.0:1784755926.946303:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322496 00000100:00100000:1.0:1784755926.946353:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784755926.946362:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322496:12345-0@lo:503: 00000100:00100000:1.0:1784755926.946608:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322496:12345-0@lo:503: Request processed in 246us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.946616:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784755926.946903:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322496:0@lo:503: 00000040:00080000:3.0:1784755926.947174:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755926.947244:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322624:0@lo:502: 00000100:00100000:3.0:1784755926.947283:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.947440:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.947494:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322624 00000100:00100000:1.0:1784755926.947498:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322624 00000100:00100000:1.0:1784755926.947537:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784755926.947544:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322624:12345-0@lo:502: 00000100:00100000:1.0:1784755926.947950:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322624:12345-0@lo:502: Request processed in 405us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.947958:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784755926.951394:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322624:0@lo:502: 00000040:00080000:3.0:1784755926.952025:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784755926.952089:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784755926.952130:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322752:0@lo:502: 00000100:00100000:3.0:1784755926.952212:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.952254:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf603670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.952313:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322752 00000100:00100000:0.0:1784755926.952320:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322752 00000100:00100000:0.0:1784755926.952372:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784755926.952382:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322752:12345-0@lo:502: 00000100:00100000:0.0:1784755926.952570:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322752:12345-0@lo:502: Request processed in 190us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.952578:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784755926.952800:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322752:0@lo:502: 00000040:00080000:1.0:1784755926.952896:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784755926.952907:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784755926.953551:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755926.953560:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755926.953562:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784755926.953568:0:6610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fcf463c1000 00000020:00000080:1.0:1784755926.953570:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784755926.953588:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755926.953592:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755926.953593:0:6610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784755926.953596:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784755926.953746:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784755926.953784:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784755926.953804:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.953815:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755926.953854:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784755926.953857:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fcf463c1000 10000000:01000000:3.0:1784755926.953861:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fcf463c1000 10000000:01000000:3.0:1784755926.953877:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755926.953883:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf463c1000 from 1 10000000:01000000:3.0:1784755926.953885:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784755926.953915:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.953924:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.953935:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.953959:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322880:0@lo:101: 00000100:00100000:3.0:1784755926.954006:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.954037:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf48843240 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.954141:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153322880 00000100:00100000:1.0:1784755926.954148:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153322880 00000100:00100000:1.0:1784755926.954199:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784755926.954208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153322880:12345-0@lo:101: 00010000:00010000:1.0:1784755926.954220:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755926.954233:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c342f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.954255:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.954267:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.954286:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82150000, rc 0) 00000100:00100000:1.0:1784755926.954332:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153322880:12345-0@lo:101: Request processed in 125us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.954339:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784755926.954528:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153322880:0@lo:101: 00010000:00010000:3.0:1784755926.954542:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755926.954552:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755926.954626:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323008:0@lo:501: 00000100:00100000:3.0:1784755926.954682:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.954707:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf48843240 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.954798:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323008 00000100:00100000:1.0:1784755926.954802:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323008 00000100:00100000:1.0:1784755926.954831:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784755926.954837:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323008:12345-0@lo:501: 00000100:00100000:1.0:1784755926.955029:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323008:12345-0@lo:501: Request processed in 191us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.955035:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784755926.955141:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323008:0@lo:501: 00000100:00100000:0.0:1784755926.955167:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323136:0@lo:503: 00000100:00100000:0.0:1784755926.955215:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.955242:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755926.955287:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323136 00000100:00100000:3.0:1784755926.955301:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323136 00000100:00100000:3.0:1784755926.955331:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784755926.955338:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323136:12345-0@lo:503: 00000100:00100000:3.0:1784755926.955464:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323136:12345-0@lo:503: Request processed in 127us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755926.955471:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784755926.955588:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323136:0@lo:503: 00000040:00080000:0.0:1784755926.955893:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784755926.955942:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323264:0@lo:502: 00000100:00100000:0.0:1784755926.955976:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.956000:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.956111:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323264 00000100:00100000:1.0:1784755926.956116:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323264 00000100:00100000:1.0:1784755926.956150:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784755926.956157:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323264:12345-0@lo:502: 00000100:00100000:1.0:1784755926.956515:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323264:12345-0@lo:502: Request processed in 358us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.956523:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784755926.957047:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323264:0@lo:502: 00000040:00080000:3.0:1784755926.958079:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784755926.958139:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784755926.958175:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784755926.958237:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784755926.958275:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784755926.958414:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784755926.958448:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784755926.958494:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784755926.958541:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784755926.958578:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784755926.958612:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784755926.958892:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784755926.958935:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784755926.958968:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784755926.959015:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784755926.959055:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784755926.959092:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784755926.959142:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784755926.959180:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784755926.959232:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784755926.959358:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784755926.959414:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784755926.959450:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784755926.959539:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784755926.959578:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1784755926.959612:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1784755926.962469:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1784755926.962545:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1784755926.962591:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323392:0@lo:502: 00000100:00100000:3.0:1784755926.963126:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755926.963216:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1784755926.963267:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323392 00000100:00100000:0.0:1784755926.963274:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323392 00000100:00100000:0.0:1784755926.963435:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784755926.963446:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323392:12345-0@lo:502: 00000100:00100000:0.0:1784755926.963921:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323392:12345-0@lo:502: Request processed in 476us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.963929:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784755926.964047:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323392:0@lo:502: 00000040:00080000:3.0:1784755926.964136:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1784755926.964149:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1784755926.964763:0:6611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784755926.964860:0:6611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fce44d9b380) 00000020:00000080:1.0:1784755926.964881:0:6611:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1784755926.965074:0:6611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fcf463c1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784755926.965079:0:6611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fcf463c1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784755926.965081:0:6611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fcf463c1000 3 00010000:00080000:1.0:1784755926.965108:0:6611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fce44a81800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.108@tcp at head 00010000:00010000:1.0:1784755926.966721:0:6611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1784755926.966816:0:6611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784755926.966847:0:6611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784755926.966859:0:6611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8f2fc1536a2c3444 00000100:00080000:1.0:1784755926.966868:0:6611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784755926.966874:0:6611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fce44a81800 using connection 192.168.202.108@tcp/0@lo 00000100:00100000:1.0:1784755926.966907:0:6611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fcf7bc0ce00 x1871452153323520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784755926.966941:0:6611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784755926.967169:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1871452153323520:0@lo:38: 00000100:00100000:2.0:1784755926.967252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.967470:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153323648:0@lo:400: 00000100:00100000:0.0:1784755926.967499:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.967537:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323520 00000100:00100000:0.0:1784755926.967544:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323520 00000100:00100000:0.0:1784755926.967567:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323648 00000100:00100000:0.0:1784755926.967570:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323648 00000100:00100000:0.0:1784755926.967594:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755926.967601:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153323648:12345-0@lo:400: 00000100:00100000:0.0:1784755926.967669:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153323648:12345-0@lo:400: Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.967676:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755926.967690:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755926.967693:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1871452153323520:12345-0@lo:38: 00010000:00080000:0.0:1784755926.967710:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1784755926.967745:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8f2fc1536a2c344b 00000004:00100000:0.0:1784755926.967758:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784755926.967801:0:5796:0:(import.c:65:import_set_state_nolock()) ffff8fce44a96000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784755926.967842:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1871452153323520:12345-0@lo:38: Request processed in 146us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755926.967848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784755926.967884:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fcf80857480 x1871452153323648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755926.967898:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153323648:0@lo:400: 00010000:00080000:0.0:1784755926.967996:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fcf7bc0ce00 x1871452153323520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755926.968004:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784755926.968010:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1784755926.968016:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784755926.968022:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784755926.968024:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fce44a81800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784755926.968029:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1871452153323520:0@lo:38: 00000040:00080000:0.0:1784755926.968157:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1784755926.968795:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1784755926.968819:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784755926.968839:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755926.968849:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784755926.968901:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784755926.968904:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784755926.968905:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755926.968906:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755926.968907:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755926.968909:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755926.968910:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755926.968911:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755926.968913:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755926.968914:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755926.968916:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784755926.968920:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784755926.968922:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784755926.968923:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784755926.968924:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755926.968925:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755926.968927:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755926.968928:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755926.968929:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755926.968930:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755926.968930:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755926.968931:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755926.968932:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784755926.968950:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784755926.968970:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323776:0@lo:253: 00000100:00100000:2.0:1784755926.969015:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755926.969046:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.969148:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323776 00000100:00100000:1.0:1784755926.969154:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323776 00000100:00100000:1.0:1784755926.969208:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784755926.969217:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6587:x1871452153323776:12345-0@lo:253: 20000000:01000000:1.0:1784755926.969239:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784755926.969252:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784755926.999221:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784755926.999239:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784755926.999297:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784755926.999302:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784755926.999325:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.999344:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.999352:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.999404:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755926.999419:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 13 pid: 5791 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755926.999433:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153323904:0@lo:104: 00000100:00100000:0.0:1784755926.999497:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755926.999552:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755926.999606:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153323904 00000100:00100000:1.0:1784755926.999613:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153323904 00000100:00100000:1.0:1784755926.999683:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784755926.999692:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153323904:12345-0@lo:104: 00010000:00010000:1.0:1784755926.999704:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.999756:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755926.999761:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153323904:12345-0@lo:104: Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755926.999767:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1784755926.999797:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755926.999803:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.999817:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82151e00 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755926.999820:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.999829:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755926.999835:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755926.999841:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755926.999869:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755926.999876:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755926.999893:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755927.000053:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82151e00/0x8f2fc1536a2c33a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755927.000068:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755927.000070:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755927.000072:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755927.000093:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153324032:0@lo:103: 00000100:00100000:1.0:1784755927.000126:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755927.000181:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153323904:0@lo:104: 00010000:00010000:1.0:1784755927.000208:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755927.000261:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324032 00000100:00100000:0.0:1784755927.000265:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324032 00010000:00010000:0.0:1784755927.000283:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 14 pid: 5791 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755927.000312:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755927.000318:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf43dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:3317:x1871452153324032:12345-0@lo:103: 00010000:00010000:0.0:1784755927.000329:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755927.000333:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 14 pid: 5791 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000344:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 14 pid: 5791 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000357:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43270a00/0x8f2fc1536a2c33aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c33a3 expref: 14 pid: 5791 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000369:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000386:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784755927.000399:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001334381s 00010000:00010000:0.0:1784755927.000403:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000410:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000416:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000422:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000427:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030c00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784755927.000431:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000437:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000448:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755927.000456:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755927.000484:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf43dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3317:x1871452153324032:12345-0@lo:103: Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755927.000490:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784755927.000663:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153324032:0@lo:103: 00010000:00010000:1.0:1784755927.000682:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755927.000689:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755927.000695:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c3452 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755927.012426:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:6587:x1871452153323776:12345-0@lo:253: Request processed in 43201us (43400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755927.012441:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784755927.012518:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6587:1871452153323776:0@lo:253: 10000000:01000000:2.0:1784755927.012532:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784755927.012535:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755927.012537:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784755927.012538:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755927.012539:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755927.012541:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755927.012542:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755927.012543:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755927.012545:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755927.012546:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755927.012548:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755927.012549:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784755927.012562:0:6587:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784755927.017871:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755927.018134:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784755927.018467:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755927.018669:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784755927.019040:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755927.019420:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784755927.020585:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1784755927.082212:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784755927.216203:0:6587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784755927.216209:0:6587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784755927.216243:0:6587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784755927.216371:0:6587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784755927.216391:0:6587:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784755927.216419:0:6587:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1784755928.100386:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755929.119452:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755930.145126:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755931.169688:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784755931.422774:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784755931.422784:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf4549c800 from 21 10000000:01000000:1.0:1784755931.422789:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755931.422836:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.422848:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.422859:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755931.422886:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324160:0@lo:101: 00000100:00100000:1.0:1784755931.422967:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.423053:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.423057:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324160 00000100:00100000:2.0:1784755931.423068:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324160 00000100:00100000:2.0:1784755931.423131:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784755931.423141:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153324160:12345-0@lo:101: 00010000:00010000:2.0:1784755931.423164:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755931.423179:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3459 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755931.423206:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755931.423215:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755931.423223:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271200, rc 0) 00000100:00100000:2.0:1784755931.423274:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324160:12345-0@lo:101: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.423280:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784755931.424587:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324160:0@lo:101: 00010000:00010000:1.0:1784755931.424626:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.424674:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755931.424755:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324288:0@lo:501: 00000100:00100000:1.0:1784755931.424797:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.424828:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755931.424995:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324288 00000100:00100000:0.0:1784755931.425000:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324288 00000100:00100000:0.0:1784755931.425193:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784755931.425204:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324288:12345-0@lo:501: 00000100:00100000:0.0:1784755931.425722:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324288:12345-0@lo:501: Request processed in 520us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755931.425731:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784755931.426128:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324288:0@lo:501: 00000100:00100000:1.0:1784755931.426175:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324416:0@lo:503: 00000100:00100000:1.0:1784755931.426216:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.426250:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.426315:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324416 00000100:00100000:2.0:1784755931.426321:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324416 00000100:00100000:2.0:1784755931.426367:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784755931.426375:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324416:12345-0@lo:503: 00000100:00100000:2.0:1784755931.426540:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324416:12345-0@lo:503: Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.426547:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784755931.426758:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324416:0@lo:503: 00000100:00100000:1.0:1784755931.428053:0:6838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6838:1871452153324544:0@lo:502: 00000100:00100000:1.0:1784755931.428121:0:6838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.428147:0:6838:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d5300 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.428382:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324544 00000100:00100000:2.0:1784755931.428389:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324544 00000100:00100000:2.0:1784755931.428425:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784755931.428434:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6838:x1871452153324544:12345-0@lo:502: 00000100:00100000:2.0:1784755931.428684:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6838:x1871452153324544:12345-0@lo:502: Request processed in 250us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.428692:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784755931.429460:0:6838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6838:1871452153324544:0@lo:502: 00000100:00100000:1.0:1784755931.429522:0:6838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6838:1871452153324672:0@lo:502: 00000100:00100000:1.0:1784755931.429560:0:6838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.429597:0:6838:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755931.431071:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324672 00000100:00100000:0.0:1784755931.431080:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324672 00000100:00100000:0.0:1784755931.431131:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784755931.431140:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6838:x1871452153324672:12345-0@lo:502: 00000100:00100000:0.0:1784755931.431361:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:6838:x1871452153324672:12345-0@lo:502: Request processed in 223us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755931.431366:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784755931.431517:0:6838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6838:1871452153324672:0@lo:502: 00000040:00080000:1.0:1784755931.431544:0:6838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784755931.435417:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784755931.435451:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755931.435463:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.435477:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755931.435485:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784755931.435488:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8fcf4549c800 from 4 10000000:01000000:0.0:1784755931.435491:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784755931.435531:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.435546:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.435557:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755931.435580:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324800:0@lo:101: 00000100:00100000:0.0:1784755931.435675:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755931.435724:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29000 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.435879:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324800 00000100:00100000:3.0:1784755931.435887:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324800 00000100:00100000:3.0:1784755931.435940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784755931.435951:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153324800:12345-0@lo:101: 00010000:00010000:3.0:1784755931.435972:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755931.435986:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3467 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.436010:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.436021:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.436030:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74010000, rc 0) 00000100:00100000:3.0:1784755931.436071:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153324800:12345-0@lo:101: Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.436078:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784755931.436283:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324800:0@lo:101: 00010000:00010000:0.0:1784755931.436299:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.436308:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755931.436380:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324928:0@lo:256: 00000100:00100000:0.0:1784755931.436426:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755931.436463:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29000 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.436623:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153324928 00000100:00100000:3.0:1784755931.436627:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153324928 00000100:00100000:3.0:1784755931.436712:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784755931.436719:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153324928:12345-0@lo:256: 20000000:01000000:3.0:1784755931.436732:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784755931.436748:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784755931.436751:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784755931.436825:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153324928:12345-0@lo:256: Request processed in 106us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.436832:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784755931.436932:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153324928:0@lo:256: 10000000:01000000:1.0:1784755931.436976:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784755931.436982:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.436989:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755931.436997:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784755931.436999:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784755931.437002:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784755931.437019:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.437026:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.437033:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755931.437045:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325056:0@lo:101: 00000100:00100000:1.0:1784755931.437070:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.437100:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.437137:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325056 00000100:00100000:3.0:1784755931.437142:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325056 00000100:00100000:3.0:1784755931.437200:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784755931.437208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153325056:12345-0@lo:101: 00010000:00010000:3.0:1784755931.437216:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755931.437238:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3475 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.437251:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.437257:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.437262:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011a00, rc 0) 00000100:00100000:3.0:1784755931.437290:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153325056:12345-0@lo:101: Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.437293:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784755931.437402:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325056:0@lo:101: 00010000:00010000:2.0:1784755931.437417:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755931.437427:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755931.437477:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325184:0@lo:501: 00000100:00100000:2.0:1784755931.437508:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.437534:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7d7b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.438494:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325184 00000100:00100000:3.0:1784755931.438502:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325184 00000100:00100000:3.0:1784755931.438539:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784755931.438547:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153325184:12345-0@lo:501: 00000100:00100000:3.0:1784755931.438807:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153325184:12345-0@lo:501: Request processed in 260us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.438816:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784755931.438861:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325184:0@lo:501: 00000100:00100000:3.0:1784755931.438899:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325312:0@lo:503: 00000100:00100000:3.0:1784755931.438940:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755931.438959:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf432893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755931.439015:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325312 00000100:00100000:1.0:1784755931.439020:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325312 00000100:00100000:1.0:1784755931.439051:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784755931.439058:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153325312:12345-0@lo:503: 00000100:00100000:1.0:1784755931.439259:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153325312:12345-0@lo:503: Request processed in 202us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755931.439265:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784755931.439307:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153325312:0@lo:503: 00000100:00100000:1.0:1784755931.439466:0:6839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6839:1871452153325440:0@lo:502: 00000100:00100000:1.0:1784755931.439492:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.439510:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325440 00000100:00100000:1.0:1784755931.439514:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325440 00000100:00100000:1.0:1784755931.439536:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784755931.439544:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:6839:x1871452153325440:12345-0@lo:502: 00000100:00100000:1.0:1784755931.439747:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:6839:x1871452153325440:12345-0@lo:502: Request processed in 204us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755931.439753:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784755931.439785:0:6839:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1784755931.439797:0:6839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6839:1871452153325440:0@lo:502: 00000020:01000000:1.0:1784755931.439820:0:6839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784755931.439827:0:6839:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784755931.439834:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755931.439836:0:6839:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784755931.439842:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784755931.439845:0:6839:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.108@tcp to nid 0x20000c0a8ca6c (192.168.202.108@tcp) 00000020:01000000:1.0:1784755931.439868:0:6839:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784755931.439870:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784755931.439883:0:6839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fce44d9cd40) 00000020:00000080:1.0:1784755931.439898:0:6839:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784755931.439902:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784755931.439960:0:6839:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784755931.439966:0:6839:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784755931.439972:0:6839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c348a 00010000:00080000:1.0:1784755931.440001:0:6839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fcf51f32000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.108@tcp at head 00010000:00010000:1.0:1784755931.440253:0:6839:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784755931.523533:0:6839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784755931.523554:0:6839:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784755931.524140:0:6839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755931.524441:0:6839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755931.524493:0:6839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784755931.524969:0:6839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784755931.525298:0:6850:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784755931.525303:0:6850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784755931.526511:0:6839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784755931.526521:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784755931.526559:0:6839:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784755931.526581:0:6839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f2fc1536a2c3491 00000100:00080000:0.0:1784755931.526590:0:6839:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784755931.526595:0:6839:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fcf51f32000 using connection 192.168.202.108@tcp/0@lo 00000100:00100000:0.0:1784755931.526624:0:6839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fcf80857b80 x1871452153325568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784755931.526665:0:6839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784755931.526715:0:6839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755931.526719:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755931.526720:0:6839:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784755931.526723:0:6839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755931.526727:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755931.526729:0:6839:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784755931.526732:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784755931.526734:0:6839:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784755931.526881:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1871452153325568:0@lo:8: 00000100:00100000:1.0:1784755931.526949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755931.527093:0:6839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6839:1871452153325952:0@lo:502: 00000100:00100000:3.0:1784755931.527122:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325568 00000100:00100000:3.0:1784755931.527130:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325568 00000100:00100000:0.0:1784755931.527141:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755931.527172:0:6839:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.527180:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755931.527188:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1871452153325568:12345-0@lo:8: 00010000:00080000:3.0:1784755931.527218:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000100:00100000:1.0:1784755931.527226:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325952 00000100:00100000:1.0:1784755931.527232:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325952 00000020:00000080:3.0:1784755931.527258:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f2fc1536a2c3498 00000100:00100000:1.0:1784755931.527272:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784755931.527280:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:6839:x1871452153325952:12345-0@lo:502: 00002000:00100000:3.0:1784755931.527293:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fce44a73000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784755931.527299:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1784755931.527303:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1784755931.527456:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1784755931.527589:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:6839:x1871452153325952:12345-0@lo:502: Request processed in 308us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755931.527597:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00002000:00080000:3.0:1784755931.527688:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1784755931.527688:0:6839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:6839:1871452153325952:0@lo:502: 00000100:00080000:3.0:1784755931.527716:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8fce44a75800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1784755931.527720:0:6839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755931.527725:0:6839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755931.527727:0:6839:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784755931.527731:0:6839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1784755931.527765:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1871452153325568:12345-0@lo:8: Request processed in 576us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.527772:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784755931.527932:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf80857b80 x1871452153325568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784755941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755931.527942:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784755931.527947:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784755931.527954:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784755931.527959:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784755931.527961:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fcf51f32000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784755931.527971:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784755931.527975:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1871452153325568:0@lo:8: 00000020:01000000:1.0:1784755931.527991:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784755931.528008:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784755931.528024:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.528034:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755931.528045:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784755931.528048:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8fcf46313380 from 1 10000000:01000000:1.0:1784755931.528051:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784755931.528072:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.528079:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.528088:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755931.528100:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153326080:0@lo:101: 00000100:00100000:1.0:1784755931.528128:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.528165:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51c5ed80 going to sleep for 11 seconds 00000004:00080000:1.0:1784755931.528179:0:6850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784755931.528264:0:6850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173641625395ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784755931.528670:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326080 00000100:00100000:0.0:1784755931.528675:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326080 00000100:00100000:0.0:1784755931.528705:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784755931.528713:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153326080:12345-0@lo:101: 00010000:00010000:0.0:1784755931.528722:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755931.528735:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c349f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.528772:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755931.528783:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755931.528803:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153325696:0@lo:400: 00010000:00010000:0.0:1784755931.528804:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030600, rc 0) 00000100:00100000:0.0:1784755931.528851:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153326080:12345-0@lo:101: Request processed in 137us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.528852:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755931.528862:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784755931.528886:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755931.528895:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153325824:0@lo:400: 00000100:00100000:2.0:1784755931.529143:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.529556:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325696 00000100:00100000:2.0:1784755931.529561:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325696 00000100:00100000:2.0:1784755931.529590:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153325824 00000100:00100000:2.0:1784755931.529593:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153325824 00000100:00100000:2.0:1784755931.529619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755931.529626:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153325696:12345-0@lo:400: 00000100:00100000:2.0:1784755931.529860:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153325696:12345-0@lo:400: Request processed in 234us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.529868:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755931.529890:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755931.529899:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153325824:12345-0@lo:400: 00000100:00100000:1.0:1784755931.530441:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153326080:0@lo:101: 00010000:00010000:1.0:1784755931.530465:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755931.530478:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755931.530558:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153326208:0@lo:501: 00000100:00100000:1.0:1784755931.530593:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.531450:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153325824:12345-0@lo:400: Request processed in 1550us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.531459:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784755931.531485:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784755931.531603:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0d180 x1871452153325824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755931.531618:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153325824:0@lo:400: 00010000:00080000:2.0:1784755931.531649:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0d880 x1871452153325696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755931.531658:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153325696:0@lo:400: 00000100:00100000:3.0:1784755931.536886:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326208 00000100:00100000:3.0:1784755931.536901:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326208 00000100:00100000:3.0:1784755931.536961:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784755931.536971:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153326208:12345-0@lo:501: 00000100:00100000:3.0:1784755931.537929:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153326208:12345-0@lo:501: Request processed in 953us (7328us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784755931.537939:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784755931.538006:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf428bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755931.538029:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153326208:0@lo:501: 10000000:01000000:3.0:1784755931.538061:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784755931.538070:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755931.538080:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784755931.597302:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1784755931.639083:0:6851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784755931.639190:0:6851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326464:0@lo:7: 00000100:00100000:2.0:1784755931.639343:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.639391:0:6851:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce46f4e540 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.639432:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153326336:0@lo:13: 00000100:00100000:2.0:1784755931.639459:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.639502:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326464 00000100:00100000:2.0:1784755931.639508:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326464 00000100:00100000:2.0:1784755931.639562:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755931.639571:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1871452153326464:12345-0@lo:7: 00000100:00080000:3.0:1784755931.644797:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755931.644834:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326336 00000100:00100000:3.0:1784755931.644844:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326336 00000100:00100000:3.0:1784755931.645250:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755931.645262:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1871452153326336:12345-0@lo:13: 00002000:00000024:3.0:1784755931.645297:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784755931.645390:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1871452153326336:12345-0@lo:13: Request processed in 130us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755931.645398:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784755931.645709:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6ea300 x1871452153326336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755931.645732:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153326336:0@lo:13: 00002000:00080000:2.0:1784755931.648249:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784755931.648257:0:6591:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784755931.648340:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1871452153326464:12345-0@lo:7: Request processed in 8767us (8994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755931.648355:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784755931.648374:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6e9880 x1871452153326464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784755947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755931.648389:0:6851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326464:0@lo:7: 00000004:00080000:3.0:1784755931.648403:0:6851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784755931.648436:0:6851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326592:0@lo:5: 00000100:00100000:3.0:1784755931.648467:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755931.648509:0:6851:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf43289480 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.648626:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326592 00000100:00100000:2.0:1784755931.648632:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326592 00000100:00100000:2.0:1784755931.648756:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755931.648764:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6851:x1871452153326592:12345-0@lo:5: 00002000:00080000:2.0:1784755931.648787:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784755931.648790:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784755931.648978:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6851:x1871452153326592:12345-0@lo:5: Request processed in 214us (509us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784755931.648984:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784755931.649829:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf60435c00 x1871452153326592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755931.649844:0:6851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326592:0@lo:5: 00000004:00080000:2.0:1784755931.649854:0:6851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784755931.649881:0:6851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326720:0@lo:700: 00000100:00100000:2.0:1784755931.649915:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.649937:0:6851:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce46f4e300 going to sleep for 11 seconds 00000100:00100000:1.0:1784755931.650010:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326720 00000100:00100000:1.0:1784755931.650015:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326720 00000100:00100000:1.0:1784755931.650047:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755931.650054:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6851:x1871452153326720:12345-0@lo:700: 00000100:00100000:1.0:1784755931.650084:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1871452153326848:0@lo:700: 00000100:00100000:1.0:1784755931.650112:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755931.650184:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf428bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755931.650339:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326848 00000100:00100000:2.0:1784755931.650343:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326848 00000100:00100000:2.0:1784755931.650400:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755931.650407:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1871452153326848:12345-0@lo:700: 40000000:02000000:1.0:1784755931.674790:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1784755931.685957:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1871452153326848:12345-0@lo:700: Request processed in 35540us (35833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755931.685977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784755931.686111:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0f800 x1871452153326848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784755947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755931.686134:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1871452153326848:0@lo:700: 40000000:02000000:0.0:1784755931.686147:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1784755931.771441:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6851:x1871452153326720:12345-0@lo:700: Request processed in 121376us (121515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755931.771461:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784755931.771999:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6eb800 x1871452153326720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784755947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755931.772015:0:6851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326720:0@lo:700: 00000001:00080000:1.0:1784755931.772392:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1784755931.772405:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1784755931.827631:0:6851:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1784755931.830698:0:6851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326976:0@lo:5: 00000100:00100000:2.0:1784755931.830761:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755931.830810:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153326976 00000100:00100000:2.0:1784755931.830817:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153326976 00000100:00100000:2.0:1784755931.830864:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755931.830872:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6851:x1871452153326976:12345-0@lo:5: 00000100:00100000:3.0:1784755931.839379:0:6851:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce46f4e840 going to sleep for 11 seconds 00002000:00080000:2.0:1784755931.844028:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1784755931.844050:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1784755931.849970:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1871452153326976:12345-0@lo:5: Request processed in 19091us (19201us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784755931.849983:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784755931.853143:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6eb800 x1871452153326976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755931.853170:0:6851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784755931.853186:0:6851:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8fcf7c6eb800 x1871452153326976/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755947 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755931.853198:0:6851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1871452153326976:0@lo:5: 00000004:00080000:0.0:1784755931.853212:0:6851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1784755932.193736:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755933.215052:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784755933.358035:0:6958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784755934.239313:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755935.264861:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755936.292706:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755936.544025:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153327104:0@lo:400: 00000100:00100000:1.0:1784755936.544099:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755936.544281:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327104 00000100:00100000:3.0:1784755936.544289:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327104 00000100:00100000:3.0:1784755936.544342:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784755936.544351:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3317:x1871452153327104:12345-0@lo:400: 00000100:00100000:2.0:1784755936.546478:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153327488:0@lo:400: 00000100:00100000:2.0:1784755936.546535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755936.546590:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153327232:0@lo:400: 00000100:00100000:2.0:1784755936.546618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755936.546662:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755936.546670:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153327360:0@lo:400: 00000100:00100000:2.0:1784755936.546693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755936.546818:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327488 00000100:00100000:0.0:1784755936.546826:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327488 00000100:00100000:0.0:1784755936.546880:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755936.546889:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1871452153327488:12345-0@lo:400: 00000100:00100000:0.0:1784755936.546968:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1871452153327488:12345-0@lo:400: Request processed in 79us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755936.546975:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784755936.546997:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784755936.547029:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6ea680 x1871452153327488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755936.547043:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153327488:0@lo:400: 00000100:00100000:2.0:1784755936.547409:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327232 00000100:00100000:2.0:1784755936.547414:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327232 00000100:00100000:2.0:1784755936.547456:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327360 00000100:00100000:2.0:1784755936.547459:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327360 00000100:00100000:2.0:1784755936.547477:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755936.547483:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153327232:12345-0@lo:400: 00000100:00100000:2.0:1784755936.547525:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153327232:12345-0@lo:400: Request processed in 41us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755936.547531:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755936.547552:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755936.547558:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153327360:12345-0@lo:400: 00000100:00100000:2.0:1784755936.547599:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153327360:12345-0@lo:400: Request processed in 41us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755936.547604:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784755936.547629:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6ea300 x1871452153327360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755936.547662:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153327360:0@lo:400: 00010000:00080000:2.0:1784755936.547674:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6e9880 x1871452153327232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755936.547681:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153327232:0@lo:400: 00000100:00100000:3.0:1784755936.548355:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3317:x1871452153327104:12345-0@lo:400: Request processed in 4001us (4252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755936.548365:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1784755936.549019:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784755936.553500:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153327104:0@lo:400: 00000100:00100000:0.0:1784755937.057037:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784755937.057193:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153327616:0@lo:13: 00000100:00100000:0.0:1784755937.057265:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755937.057343:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327616 00000100:00100000:0.0:1784755937.057351:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327616 00000100:00100000:0.0:1784755937.057400:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755937.057410:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1871452153327616:12345-0@lo:13: 00002000:00000024:0.0:1784755937.057449:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755937.057504:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1871452153327616:12345-0@lo:13: Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755937.057511:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784755937.057564:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf80855c00 x1871452153327616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755937.057585:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153327616:0@lo:13: 00000001:00080000:1.0:1784755937.136512:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1784755937.327234:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755938.338208:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755939.359800:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755940.388933:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755941.407812:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755941.669929:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153328000:0@lo:400: 00000100:00100000:1.0:1784755941.669998:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755941.670053:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784755941.670071:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153328128:0@lo:400: 00000100:00100000:1.0:1784755941.670100:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755941.670146:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328000 00000100:00100000:1.0:1784755941.670152:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328000 00000100:00100000:1.0:1784755941.670215:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755941.670225:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153328000:12345-0@lo:400: 00000100:00100000:1.0:1784755941.670277:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153328000:12345-0@lo:400: Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755941.670284:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755941.670327:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328128 00000100:00100000:1.0:1784755941.670332:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328128 00000100:00100000:1.0:1784755941.670364:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755941.670371:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153328128:12345-0@lo:400: 00000100:00100000:1.0:1784755941.670403:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153328128:12345-0@lo:400: Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755941.670550:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153327872:0@lo:400: 00000100:00100000:3.0:1784755941.670584:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755941.670607:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784755941.670613:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153327744:0@lo:400: 00000100:00100000:3.0:1784755941.670664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755941.670694:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327872 00000100:00100000:3.0:1784755941.670698:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327872 00000100:00100000:3.0:1784755941.670722:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755941.670728:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153327872:12345-0@lo:400: 00000100:00100000:3.0:1784755941.670759:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153327872:12345-0@lo:400: Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755941.670765:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755941.670781:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153327744 00000100:00100000:3.0:1784755941.670784:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153327744 00000100:00100000:3.0:1784755941.670805:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784755941.670810:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3315:x1871452153327744:12345-0@lo:400: 00000100:00100000:3.0:1784755941.670839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3315:x1871452153327744:12345-0@lo:400: Request processed in 29us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755941.670845:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784755941.670890:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153327744:0@lo:400: 00010000:00080000:3.0:1784755941.670906:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0c000 x1871452153327872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755941.670919:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153327872:0@lo:400: 00000100:00100000:1.0:1784755941.671731:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784755941.671759:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784755941.671764:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784755941.671796:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0df80 x1871452153328128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755941.671806:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784755941.671817:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153328128:0@lo:400: 00010000:00080000:1.0:1784755941.671827:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7bc0c380 x1871452153328000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755941.671842:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153328000:0@lo:400: 00000020:01000004:3.0:1784755942.029164:0:7480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784755942.029169:0:7480:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784755942.029291:0:7480:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8fce44a76800 00000020:01000004:3.0:1784755942.029313:0:7480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784755942.029326:0:7480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784755942.029341:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fcf7c6f0000) 00000020:00000080:3.0:1784755942.029358:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784755942.050920:0:7480:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784755942.051273:0:7480:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1784755942.085730:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1784755942.091880:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1784755942.091903:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1784755942.091967:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1784755942.091989:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1784755942.093448:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784755942.093461:0:7480:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784755942.093473:0:7480:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f2fc1536a2c34b4 00000020:01000004:0.0:1784755942.093482:0:7480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1784755942.093502:0:7480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.108@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784755942.093506:0:7480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784755942.093512:0:7480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784755942.093534:0:7480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1784755942.093538:0:7480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784755942.112409:0:7480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784755942.112443:0:7480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.108@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1784755942.112447:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784755942.112449:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784755942.112451:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755942.112452:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755942.112453:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755942.112454:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755942.112456:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755942.112457:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755942.112458:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755942.112460:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755942.112461:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784755942.112464:0:7480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1784755942.112467:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784755942.112468:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784755942.112469:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755942.112470:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755942.112471:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755942.112472:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755942.112474:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755942.112475:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755942.112476:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755942.112477:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755942.112478:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784755942.112513:0:7480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784755942.112532:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153328256:0@lo:253: 00000100:00100000:1.0:1784755942.112605:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.112843:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4289f300 going to sleep for 11 seconds 00000100:00100000:3.0:1784755942.113111:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328256 00000100:00100000:3.0:1784755942.113121:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328256 00000100:00100000:3.0:1784755942.113218:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784755942.113230:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:7480:x1871452153328256:12345-0@lo:253: 20000000:01000000:3.0:1784755942.113269:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784755942.113274:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1784755942.113278:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1784755942.113281:0:5791:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1784755942.114390:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755942.114601:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784755942.114615:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1784755942.114816:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784755942.114826:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1784755942.114861:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1784755942.115023:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1784755942.115397:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1784755942.115416:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.108@tcp 20000000:01000000:3.0:1784755942.115418:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.108@tcp (null) (null) (null) 00000040:00080000:3.0:1784755942.115453:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1784755942.115462:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784755942.115524:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1784755942.115533:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.108@tcp (null) (null) 00000040:00080000:3.0:1784755942.115569:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1784755942.115578:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784755942.115608:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1784755942.116064:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1784755942.117093:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1784755942.117121:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.108@tcp 20000000:01000000:3.0:1784755942.117123:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.108@tcp (null) (null) (null) 00000040:00080000:3.0:1784755942.117160:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1784755942.117168:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784755942.117198:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1784755942.117206:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.108@tcp (null) (null) 00000040:00080000:3.0:1784755942.117237:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1784755942.117246:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784755942.117289:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1784755942.117328:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1784755942.117346:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784755942.117349:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784755942.117352:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784755942.117364:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784755942.117366:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784755942.117400:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784755942.117402:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784755942.118277:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1784755942.118345:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1784755942.118377:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1784755942.118885:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1784755942.119062:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1784755942.119139:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1784755942.119154:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784755942.119156:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784755942.119617:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1784755942.120037:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1784755942.120116:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1784755942.120427:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1784755942.120468:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1784755942.120504:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1784755942.120517:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784755942.120519:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784755942.121265:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784755942.121313:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784755942.121364:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1784755942.121611:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1784755942.121850:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1784755942.122032:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1784755942.122049:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784755942.122061:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784755942.122487:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1784755942.122865:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1784755942.123042:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1784755942.123121:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1784755942.123136:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1784755942.123138:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1784755942.123146:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784755942.123164:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123183:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123190:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123197:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123203:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123209:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123215:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123250:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123264:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 16 pid: 5789 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.123288:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328384:0@lo:104: 00000100:00100000:3.0:1784755942.123354:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755942.123445:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123453:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.123462:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328512:0@lo:104: 00010000:00010000:3.0:1784755942.123488:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123496:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 16 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.123504:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328640:0@lo:104: 00010000:00010000:3.0:1784755942.123528:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123536:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.123544:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328768:0@lo:104: 00010000:00010000:3.0:1784755942.123568:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.123576:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.123596:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328896:0@lo:104: 00000100:00100000:3.0:1784755942.123616:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf604d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755942.123993:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784755942.124013:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.124087:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.124195:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.124214:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328384 00000100:00100000:2.0:1784755942.124221:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328384 00000100:00100000:2.0:1784755942.124256:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328512 00000100:00100000:2.0:1784755942.124259:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328512 00000100:00100000:2.0:1784755942.124269:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328640 00000100:00100000:2.0:1784755942.124272:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328640 00000100:00100000:2.0:1784755942.124285:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755942.124293:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf449e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5791:x1871452153328384:12345-0@lo:104: 00010000:00010000:2.0:1784755942.124306:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.124429:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755942.124436:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf449e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:5791:x1871452153328384:12345-0@lo:104: Request processed in 144us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.124442:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755942.124479:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755942.124485:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:5791:x1871452153328512:12345-0@lo:104: 00010000:00010000:2.0:1784755942.124492:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.124524:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784755942.124529:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:5791:x1871452153328512:12345-0@lo:104: Request processed in 45us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.124535:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755942.124547:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755942.124553:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328640:12345-0@lo:104: 00010000:00010000:2.0:1784755942.124559:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.124584:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784755942.124588:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328640:12345-0@lo:104: Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.124594:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755942.124774:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328768 00000100:00100000:2.0:1784755942.124779:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328768 00000100:00100000:2.0:1784755942.124797:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755942.124803:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328768:12345-0@lo:104: 00010000:00010000:2.0:1784755942.124820:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.124849:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784755942.124855:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328768:12345-0@lo:104: Request processed in 51us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.124861:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784755942.124896:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.125046:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153328896 00000100:00100000:2.0:1784755942.125050:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153328896 00000100:00100000:2.0:1784755942.125080:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755942.125086:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328896:12345-0@lo:104: 00010000:00010000:2.0:1784755942.125094:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125158:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784755942.125166:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125184:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82151000 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.125188:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125197:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.125204:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.125209:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.125241:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125248:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.125272:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125279:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c349f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34a6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125293:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784755942.125296:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125302:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82151800 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.125304:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125321:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.125327:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.125333:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.125346:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125352:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.125358:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125365:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82151800/0x8f2fc1536a2c3475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c347c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125374:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784755942.125377:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125382:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82150e00 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.125385:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125391:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.125397:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.125408:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.125422:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125428:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.125442:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125448:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3460 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125458:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755942.125461:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125467:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74011800 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.125470:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125477:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.125483:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.125487:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.125500:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125506:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.125520:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125526:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74011800/0x8f2fc1536a2c342f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3436 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.125535:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.125537:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.125538:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.125545:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755942.125565:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153329024:0@lo:103: 00000100:00100000:3.0:1784755942.125699:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328384:0@lo:104: 00000100:00100000:3.0:1784755942.125711:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153329152:0@lo:103: 00010000:00010000:2.0:1784755942.125890:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755942.125896:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5791:x1871452153328896:12345-0@lo:104: Request processed in 810us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.125903:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755942.126101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.126159:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153329280:0@lo:103: 00000100:00100000:1.0:1784755942.126183:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.126201:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784755942.126207:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153329408:0@lo:103: 00000100:00100000:1.0:1784755942.126227:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.126259:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329024 00000100:00100000:1.0:1784755942.126264:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329024 00010000:00010000:1.0:1784755942.126286:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 17 pid: 5789 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.126302:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329280 00000100:00100000:1.0:1784755942.126305:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329280 00010000:00010000:1.0:1784755942.126316:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 18 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.126327:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329408 00000100:00100000:1.0:1784755942.126329:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329408 00010000:00010000:1.0:1784755942.126338:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 19 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.126361:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755942.126368:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153329024:12345-0@lo:103: 00010000:00010000:1.0:1784755942.126379:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755942.126385:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 19 pid: 5789 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126397:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 19 pid: 5789 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126412:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030600/0x8f2fc1536a2c34a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c349f expref: 19 pid: 5789 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126426:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755942.126457:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:3314:x1871452153329024:12345-0@lo:103: Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.126463:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755942.126478:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784755942.126485:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3316:x1871452153329280:12345-0@lo:103: 00010000:00010000:1.0:1784755942.126491:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755942.126496:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 17 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126504:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 17 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126514:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755942.126540:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3316:x1871452153329280:12345-0@lo:103: Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.126555:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784755942.126569:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755942.126575:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3316:x1871452153329408:12345-0@lo:103: 00010000:00010000:1.0:1784755942.126583:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755942.126587:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126594:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126603:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755942.126622:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3316:x1871452153329408:12345-0@lo:103: Request processed in 48us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.126627:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755942.126680:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153329408:0@lo:103: 00000100:00100000:1.0:1784755942.126698:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153329280:0@lo:103: 00000100:00100000:1.0:1784755942.126726:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153329024:0@lo:103: 00010000:00010000:1.0:1784755942.126737:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755942.126741:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126748:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030400 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.126751:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126759:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.126771:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.126776:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.126801:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126807:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.126815:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126822:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c3405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c340c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.126838:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.126840:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.126841:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755942.126854:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153329536:0@lo:103: 00000100:00100000:1.0:1784755942.126875:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.126897:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329536 00000100:00100000:1.0:1784755942.126901:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329536 00010000:00010000:1.0:1784755942.127176:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.127208:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784755942.127214:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3314:x1871452153329536:12345-0@lo:103: 00010000:00010000:1.0:1784755942.127222:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755942.127226:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.127239:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 16 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.127250:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755942.127278:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3314:x1871452153329536:12345-0@lo:103: Request processed in 65us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.127284:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784755942.127311:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153329536:0@lo:103: 00000100:00100000:3.0:1784755942.133576:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.133818:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329152 00000100:00100000:2.0:1784755942.133828:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329152 00010000:00010000:2.0:1784755942.133860:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755942.133894:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755942.133903:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3315:x1871452153329152:12345-0@lo:103: 00010000:00010000:2.0:1784755942.134038:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755942.134046:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134081:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 16 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134103:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134112:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134129:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134136:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134144:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134150:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134157:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74010200 already unused, calling callback (ffffffffc1599230) 00010000:00010000:2.0:1784755942.134162:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134169:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134179:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.134198:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755942.134241:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3315:x1871452153329152:12345-0@lo:103: Request processed in 339us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.134248:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784755942.134578:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153329152:0@lo:103: 00010000:00010000:3.0:1784755942.134614:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c347c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3475 expref: 15 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.134626:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328512:0@lo:104: 00010000:00010000:3.0:1784755942.134668:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3459 expref: 14 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.134677:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328640:0@lo:104: 00010000:00010000:3.0:1784755942.134826:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c342f expref: 13 pid: 5790 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.134838:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328768:0@lo:104: 00010000:00010000:3.0:1784755942.134849:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c340c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3405 expref: 12 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.134858:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5791:1871452153328896:0@lo:104: 00010000:00010000:3.0:1784755942.134881:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.134902:0:5791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.134909:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.135043:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74010200/0x8f2fc1536a2c34bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755942.135067:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784755942.175193:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153329664:0@lo:13: 00000100:00100000:2.0:1784755942.175278:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.175609:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329664 00000100:00100000:0.0:1784755942.175617:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329664 00000100:00100000:0.0:1784755942.175697:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755942.175707:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153329664:12345-0@lo:13: 00002000:00000024:0.0:1784755942.175743:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755942.175804:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153329664:12345-0@lo:13: Request processed in 98us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755942.175822:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784755942.176072:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf80856a00 x1871452153329664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755942.176089:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153329664:0@lo:13: 00000100:00100000:3.0:1784755942.189504:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:7480:x1871452153328256:12345-0@lo:253: Request processed in 76265us (76887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755942.189521:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784755942.190209:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153328256:0@lo:253: 10000000:01000000:0.0:1784755942.190225:0:7480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784755942.190229:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784755942.190231:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784755942.190232:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755942.190234:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1784755942.190235:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755942.190237:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755942.190238:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755942.190240:0:7480:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784755942.190242:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755942.190243:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784755942.190264:0:7480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fce44a76800 from lustre-OST0001 10000000:01000000:0.0:1784755942.190289:0:7480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784755942.190292:0:7480:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784755942.190300:0:7480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fcf46313380 local copy 10000000:01000000:0.0:1784755942.190304:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784755942.190341:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.190352:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.190362:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755942.190381:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153329792:0@lo:101: 00000100:00100000:0.0:1784755942.190423:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.190464:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.190579:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329792 00000100:00100000:2.0:1784755942.190587:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329792 00000100:00100000:2.0:1784755942.190633:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784755942.190665:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:7480:x1871452153329792:12345-0@lo:101: 00010000:00010000:2.0:1784755942.190681:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755942.190708:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c34c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c34c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.190733:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c34c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34c2 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.190744:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c34c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34c2 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.190753:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271400, rc 0) 00000100:00100000:2.0:1784755942.190788:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153329792:12345-0@lo:101: Request processed in 125us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.190810:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784755942.191034:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153329792:0@lo:101: 00010000:00010000:0.0:1784755942.191067:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.191078:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755942.191306:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153329920:0@lo:501: 00000100:00100000:0.0:1784755942.191339:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.191410:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784755942.191894:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153329920 00000100:00100000:3.0:1784755942.191901:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153329920 00000100:00100000:3.0:1784755942.192110:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784755942.192120:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153329920:12345-0@lo:501: 00000100:00100000:3.0:1784755942.192371:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153329920:12345-0@lo:501: Request processed in 252us (1030us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784755942.192379:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784755942.192454:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153329920:0@lo:501: 10000000:01000000:0.0:1784755942.192472:0:7480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784755942.192503:0:7480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784755942.192509:0:7480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.192519:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.192527:0:7480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.192552:0:7480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784755942.192576:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fce44a76800 10000000:01000000:0.0:1784755942.192581:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784755942.192586:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784755942.192588:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784755942.192592:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784755942.192594:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784755942.192623:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.192632:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.192668:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755942.192696:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330048:0@lo:101: 00000100:00100000:0.0:1784755942.192725:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784755942.192775:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755942.192782:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.192790:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030400 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:1.0:1784755942.192794:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.192803:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755942.192809:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.192815:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755942.192836:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.192843:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755942.192863:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.192880:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf40030400/0x8f2fc1536a2c34c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f2fc1536a2c34c9 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.192892:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.192894:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755942.192896:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755942.192909:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153330176:0@lo:103: 00000100:00100000:1.0:1784755942.193199:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.193256:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330176 00000100:00100000:1.0:1784755942.193261:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330176 00000100:00100000:1.0:1784755942.193297:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755942.193304:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3316:x1871452153330176:12345-0@lo:103: 00010000:00010000:1.0:1784755942.193314:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755942.193328:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c34c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f2fc1536a2c34c2 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.193341:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755942.193369:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:3316:x1871452153330176:12345-0@lo:103: Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.193375:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755942.193402:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153330176:0@lo:103: 00000100:00100000:0.0:1784755942.193609:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.193802:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330048 00000100:00100000:2.0:1784755942.193807:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330048 00000100:00100000:2.0:1784755942.193833:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784755942.193839:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+11:7480:x1871452153330048:12345-0@lo:101: 00010000:00010000:2.0:1784755942.193848:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755942.193860:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c34d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.193876:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.193885:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.193891:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270800, rc 0) 00000100:00100000:2.0:1784755942.194095:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330048:12345-0@lo:101: Request processed in 255us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.194101:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784755942.194188:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330048:0@lo:101: 00010000:00010000:0.0:1784755942.194202:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.194211:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755942.194298:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330304:0@lo:501: 00000100:00100000:0.0:1784755942.194341:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.194373:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.194483:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330304 00000100:00100000:2.0:1784755942.194488:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330304 00000100:00100000:2.0:1784755942.194508:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784755942.194514:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330304:12345-0@lo:501: 00000100:00100000:2.0:1784755942.194809:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330304:12345-0@lo:501: Request processed in 293us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.194816:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784755942.194898:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330304:0@lo:501: 00000100:00100000:0.0:1784755942.195067:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330432:0@lo:503: 00000100:00100000:0.0:1784755942.195107:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.195135:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.195246:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330432 00000100:00100000:2.0:1784755942.195250:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330432 00000100:00100000:2.0:1784755942.195278:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784755942.195284:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330432:12345-0@lo:503: 00000100:00100000:2.0:1784755942.195435:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330432:12345-0@lo:503: Request processed in 151us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.195442:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784755942.195565:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330432:0@lo:503: 00000040:00080000:0.0:1784755942.195857:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784755942.196146:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330560:0@lo:502: 00000100:00100000:0.0:1784755942.196197:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.196219:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.196329:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330560 00000100:00100000:2.0:1784755942.196335:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330560 00000100:00100000:2.0:1784755942.196358:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784755942.196365:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330560:12345-0@lo:502: 00000100:00100000:2.0:1784755942.196509:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330560:12345-0@lo:502: Request processed in 143us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.196515:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784755942.196673:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330560:0@lo:502: 00000040:00080000:0.0:1784755942.197255:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784755942.197311:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784755942.197349:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784755942.197399:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784755942.197439:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784755942.197475:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784755942.197505:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330688:0@lo:502: 00000100:00100000:0.0:1784755942.197553:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.197672:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755942.197845:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330688 00000100:00100000:1.0:1784755942.197851:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330688 00000100:00100000:2.0:1784755942.197923:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784755942.197992:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330688:12345-0@lo:502: 00000100:00100000:2.0:1784755942.198181:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330688:12345-0@lo:502: Request processed in 191us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.198188:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784755942.198384:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330688:0@lo:502: 00000040:00080000:0.0:1784755942.198475:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784755942.198486:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784755942.199611:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784755942.199620:0:7488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784755942.199627:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755942.199630:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784755942.199663:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784755942.199678:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fcf7c6f3380) 00000020:00000080:3.0:1784755942.199708:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784755942.199714:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784755942.199784:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fce44a76800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784755942.199795:0:7488:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784755942.199801:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f2fc1536a2c34e5 00010000:00010000:3.0:1784755942.204272:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784755942.204622:0:7488:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784755942.206697:0:7488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784755942.206936:0:7488:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784755942.213817:0:7488:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784755942.214505:0:7488:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784755942.216590:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784755942.216603:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755942.216611:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755942.216613:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784755942.216618:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755942.216622:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755942.216623:0:7488:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784755942.216627:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784755942.216629:0:7488:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784755942.218982:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755942.218994:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755942.218997:0:7488:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784755942.219003:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784755942.219304:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1784755942.219335:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784755942.219360:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.219373:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755942.219394:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fce44a76800 from 1 10000000:01000000:2.0:1784755942.219397:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784755942.219432:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.219440:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.219452:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755942.219476:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330816:0@lo:101: 00000100:00100000:2.0:1784755942.219541:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.219575:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.219597:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330816 00000100:00100000:2.0:1784755942.219602:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330816 00000100:00100000:2.0:1784755942.219675:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784755942.220000:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:7480:x1871452153330816:12345-0@lo:101: 00010000:00010000:2.0:1784755942.220013:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755942.220026:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c34ec expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.220048:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.220070:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.220079:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271800, rc 0) 00000100:00100000:2.0:1784755942.220126:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153330816:12345-0@lo:101: Request processed in 443us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.220132:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784755942.220404:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330816:0@lo:101: 00010000:00010000:2.0:1784755942.220419:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.220428:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755942.220516:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330944:0@lo:501: 00000100:00100000:2.0:1784755942.220543:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.220572:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784755942.221040:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153330944 00000100:00100000:0.0:1784755942.221064:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153330944 00000100:00100000:0.0:1784755942.221103:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784755942.221112:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153330944:12345-0@lo:501: 00000100:00100000:0.0:1784755942.221429:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153330944:12345-0@lo:501: Request processed in 318us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755942.221437:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784755942.221562:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153330944:0@lo:501: 00000100:00100000:2.0:1784755942.221593:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331072:0@lo:503: 00000100:00100000:2.0:1784755942.221658:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.222215:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51f29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784755942.222346:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331072 00000100:00100000:0.0:1784755942.222352:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331072 00000100:00100000:0.0:1784755942.222386:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784755942.222393:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331072:12345-0@lo:503: 00000100:00100000:0.0:1784755942.224386:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331072:12345-0@lo:503: Request processed in 1985us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755942.224400:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784755942.224560:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331072:0@lo:503: 00000040:00080000:2.0:1784755942.226469:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784755942.226574:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331200:0@lo:502: 00000100:00100000:2.0:1784755942.226679:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.227324:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331200 00000100:00100000:0.0:1784755942.227333:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331200 00000100:00100000:2.0:1784755942.227477:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf43714240 going to sleep for 11 seconds 00000100:00100000:0.0:1784755942.228809:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784755942.228823:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331200:12345-0@lo:502: 00000100:00100000:0.0:1784755942.229132:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331200:12345-0@lo:502: Request processed in 313us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755942.229141:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784755942.229331:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331200:0@lo:502: 00000040:00080000:2.0:1784755942.229654:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784755942.229726:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784755942.229761:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331328:0@lo:502: 00000100:00100000:2.0:1784755942.229811:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.236448:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1784755942.236579:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331328 00000100:00100000:1.0:1784755942.236589:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331328 00000100:00100000:1.0:1784755942.236662:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784755942.236672:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331328:12345-0@lo:502: 00000100:00100000:1.0:1784755942.237280:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331328:12345-0@lo:502: Request processed in 608us (7467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.237289:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784755942.237412:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331328:0@lo:502: 00000040:00080000:2.0:1784755942.237572:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784755942.237588:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784755942.238559:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755942.238569:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755942.238572:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784755942.238579:0:7492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fce44a76800 00000020:00000080:1.0:1784755942.238581:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784755942.238599:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755942.238602:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755942.238604:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784755942.238606:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784755942.239047:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784755942.239081:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784755942.239096:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.239108:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755942.239146:0:7480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784755942.239268:0:7480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fce44a76800 10000000:01000000:1.0:1784755942.239273:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fce44a76800 10000000:01000000:1.0:1784755942.239277:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784755942.239283:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fce44a76800 from 1 10000000:01000000:1.0:1784755942.239285:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755942.239318:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.239325:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.239347:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.239368:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331456:0@lo:101: 00000100:00100000:1.0:1784755942.239441:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.239481:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4289f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.239681:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331456 00000100:00100000:2.0:1784755942.239697:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331456 00000100:00100000:2.0:1784755942.239739:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784755942.239748:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153331456:12345-0@lo:101: 00010000:00010000:2.0:1784755942.239761:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755942.239774:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c34fa expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.239796:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.239806:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755942.239815:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271a00, rc 0) 00000100:00100000:2.0:1784755942.239852:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331456:12345-0@lo:101: Request processed in 105us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.239858:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784755942.240403:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331456:0@lo:101: 00010000:00010000:1.0:1784755942.240418:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.240427:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.240515:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331584:0@lo:501: 00000100:00100000:1.0:1784755942.240546:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.240569:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4289f300 going to sleep for 11 seconds 00000100:00100000:1.0:1784755942.240587:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331584 00000100:00100000:1.0:1784755942.240591:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331584 00000100:00100000:1.0:1784755942.240612:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784755942.240618:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331584:12345-0@lo:501: 00000100:00100000:1.0:1784755942.241292:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331584:12345-0@lo:501: Request processed in 671us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.241300:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784755942.241385:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331584:0@lo:501: 00000100:00100000:2.0:1784755942.241418:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331712:0@lo:503: 00000100:00100000:2.0:1784755942.241459:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.241481:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784755942.241584:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331712 00000100:00100000:1.0:1784755942.241589:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331712 00000100:00100000:1.0:1784755942.241624:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784755942.241630:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331712:12345-0@lo:503: 00000100:00100000:1.0:1784755942.241901:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331712:12345-0@lo:503: Request processed in 271us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.241908:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784755942.242228:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331712:0@lo:503: 00000040:00080000:1.0:1784755942.242561:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784755942.242621:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331840:0@lo:502: 00000100:00100000:1.0:1784755942.243023:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.243061:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4289ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755942.243230:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331840 00000100:00100000:3.0:1784755942.243236:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331840 00000100:00100000:3.0:1784755942.243274:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784755942.243281:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331840:12345-0@lo:502: 00000100:00100000:3.0:1784755942.243620:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331840:12345-0@lo:502: Request processed in 338us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755942.243628:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784755942.244142:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331840:0@lo:502: 00000040:00080000:2.0:1784755942.244598:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784755942.244882:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784755942.245086:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784755942.245145:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784755942.245262:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784755942.245311:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784755942.245346:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784755942.245462:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784755942.245533:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784755942.245573:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784755942.245611:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784755942.246568:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784755942.246620:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784755942.246873:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784755942.247035:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784755942.247088:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784755942.247122:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784755942.247250:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784755942.247311:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784755942.247345:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784755942.247474:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784755942.247515:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784755942.247551:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784755942.247618:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784755942.248045:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784755942.248098:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784755942.248233:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784755942.248275:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1784755942.248308:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784755942.248352:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1784755942.248471:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1784755942.248519:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1784755942.248553:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1784755942.248603:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1784755942.248878:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1784755942.249525:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1784755942.249575:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1784755942.249856:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331968:0@lo:502: 00000100:00100000:2.0:1784755942.250089:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.250196:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784755942.250316:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153331968 00000100:00100000:1.0:1784755942.250323:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153331968 00000100:00100000:1.0:1784755942.250485:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784755942.250496:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331968:12345-0@lo:502: 00000100:00100000:1.0:1784755942.250770:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153331968:12345-0@lo:502: Request processed in 276us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755942.250777:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784755942.250870:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153331968:0@lo:502: 00000040:00080000:2.0:1784755942.251164:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1784755942.251180:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784755942.252044:0:7493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784755942.252070:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fcf7b4919c0) 00000020:00000080:2.0:1784755942.252091:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1784755942.252272:0:7493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fce44a76800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784755942.252276:0:7493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fce44a76800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784755942.252279:0:7493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fce44a76800 3 00010000:00080000:2.0:1784755942.252307:0:7493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fce46f39000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.108@tcp at head 00010000:00010000:2.0:1784755942.259855:0:7493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784755942.260525:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784755942.260564:0:7493:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784755942.260579:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8f2fc1536a2c350f 00000100:00080000:2.0:1784755942.260590:0:7493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784755942.260595:0:7493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fce46f39000 using connection 192.168.202.108@tcp/0@lo 00000100:00100000:2.0:1784755942.260629:0:7493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fcf7c6e9f80 x1871452153332096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784755942.261118:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1871452153332096:0@lo:38: 00000100:00080000:2.0:1784755942.261227:0:7493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784755942.262819:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.263707:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332096 00000100:00100000:2.0:1784755942.263725:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332096 00000100:00100000:2.0:1784755942.263768:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755942.263777:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1871452153332096:12345-0@lo:38: 00010000:00080000:2.0:1784755942.263807:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1784755942.263861:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8f2fc1536a2c3516 00000004:00100000:2.0:1784755942.263881:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784755942.263937:0:5796:0:(import.c:65:import_set_state_nolock()) ffff8fce46f3e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755942.264012:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1871452153332096:12345-0@lo:38: Request processed in 235us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.264020:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1784755942.264204:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1784755942.264562:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1784755942.264590:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755942.264610:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755942.264620:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784755942.264691:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784755942.264693:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784755942.264694:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755942.264696:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755942.264697:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755942.264698:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755942.264700:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755942.264701:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755942.264703:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755942.264704:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755942.264706:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755942.264709:0:7480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1784755942.264711:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784755942.264713:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784755942.264714:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755942.264715:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755942.264716:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755942.264717:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755942.264718:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755942.264719:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755942.264719:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755942.264720:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755942.264721:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755942.264741:0:7480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784755942.264756:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153332224:0@lo:253: 00000100:00100000:0.0:1784755942.264804:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.264832:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf51e31780 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.265459:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784755942.265474:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153332352:0@lo:400: 00000100:00100000:2.0:1784755942.265515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.265545:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755942.265553:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153332480:0@lo:400: 00000100:00100000:2.0:1784755942.265576:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755942.265603:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332352 00000100:00100000:2.0:1784755942.265609:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332352 00000100:00100000:2.0:1784755942.265678:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332480 00000100:00100000:2.0:1784755942.265750:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332480 00000100:00100000:2.0:1784755942.265776:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755942.265784:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153332352:12345-0@lo:400: 00000100:00100000:2.0:1784755942.265829:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153332352:12345-0@lo:400: Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.265836:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755942.265850:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755942.265855:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153332480:12345-0@lo:400: 00000100:00100000:2.0:1784755942.265900:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153332480:12345-0@lo:400: Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755942.265906:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1784755942.266088:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf60437b80 x1871452153332480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755942.266103:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153332480:0@lo:400: 00010000:00080000:2.0:1784755942.266137:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf60437100 x1871452153332352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755942.266146:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153332352:0@lo:400: 00010000:00080000:0.0:1784755942.266798:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf7c6e9f80 x1871452153332096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755942.266807:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784755942.266815:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784755942.266823:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784755942.266828:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784755942.266840:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fce46f39000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784755942.266846:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1871452153332096:0@lo:38: 00000100:00100000:0.0:1784755942.267043:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7495:1871452153332608:0@lo:901: 00000100:00100000:0.0:1784755942.267100:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755942.267132:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce46f4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755942.267253:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332224 00000100:00100000:2.0:1784755942.267259:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332224 00000100:00100000:2.0:1784755942.267295:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784755942.267303:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7480:x1871452153332224:12345-0@lo:253: 20000000:01000000:2.0:1784755942.267330:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784755942.267343:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784755942.267510:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332608 00000100:00100000:3.0:1784755942.267514:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332608 00000100:00100000:3.0:1784755942.267559:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755942.267566:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7495:x1871452153332608:12345-0@lo:901: 00000100:00080000:0.0:1784755942.267781:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755942.269846:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7495:x1871452153332608:12345-0@lo:901: Request processed in 2269us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755942.269859:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784755942.270341:0:7495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fcf80856a00 x1871452153332608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784755958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755942.270356:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7495:1871452153332608:0@lo:901: 20000000:01000000:3.0:1784755942.303075:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784755942.303101:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784755942.303207:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784755942.303213:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784755942.303234:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.303253:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.303262:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.303319:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.303332:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.303347:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153332736:0@lo:104: 00000100:00100000:1.0:1784755942.303422:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755942.303473:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf607ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1784755942.303602:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332736 00000100:00100000:3.0:1784755942.303611:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332736 00000100:00100000:3.0:1784755942.303679:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755942.303699:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153332736:12345-0@lo:104: 00010000:00010000:3.0:1784755942.303712:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303787:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784755942.303793:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:5812:x1871452153332736:12345-0@lo:104: Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755942.303801:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784755942.303823:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784755942.303829:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303836:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40031e00 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:3.0:1784755942.303840:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303848:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755942.303855:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755942.303860:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755942.303889:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303896:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755942.303930:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303937:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf40031e00/0x8f2fc1536a2c3467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.303967:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755942.303969:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755942.303971:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755942.303989:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153332864:0@lo:103: 00000100:00100000:3.0:1784755942.304017:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755942.304067:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332864 00000100:00100000:3.0:1784755942.304071:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332864 00010000:00010000:3.0:1784755942.304087:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 15 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755942.304108:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755942.304113:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf43dca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:3315:x1871452153332864:12345-0@lo:103: 00010000:00010000:3.0:1784755942.304123:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755942.304127:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 15 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304137:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 15 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304153:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304161:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755942.304173:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001334381s 00010000:00010000:3.0:1784755942.304177:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304193:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304200:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304205:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304211:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82151800 already unused, calling callback (ffffffffc1599230) 00010000:00010000:3.0:1784755942.304215:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304222:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304231:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755942.304242:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755942.304271:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf43dca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:3315:x1871452153332864:12345-0@lo:103: Request processed in 157us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755942.304278:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755942.304333:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153332864:0@lo:103: 00010000:00010000:1.0:1784755942.304601:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74010000/0x8f2fc1536a2c346e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3467 expref: 14 pid: 5791 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755942.304612:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871452153332736:0@lo:104: 00010000:00010000:1.0:1784755942.304623:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.304631:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.304677:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755942.304683:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c351d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755942.316883:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:7480:x1871452153332224:12345-0@lo:253: Request processed in 49569us (52067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755942.316899:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784755942.317124:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7480:1871452153332224:0@lo:253: 10000000:01000000:2.0:1784755942.317140:0:7480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784755942.317143:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755942.317145:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784755942.317147:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755942.317148:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755942.317149:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755942.317151:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755942.317233:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784755942.317235:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755942.317236:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755942.317238:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755942.317239:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784755942.317262:0:7480:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784755942.324147:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755942.324343:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755942.325837:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755942.326033:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755942.326432:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755942.326678:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784755942.327561:0:7480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1784755942.432529:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784755942.556159:0:7480:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784755942.556168:0:7480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784755942.556206:0:7480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784755942.556273:0:7480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784755942.556288:0:7480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784755942.556316:0:7480:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1784755943.454760:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755944.479860:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755945.502793:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755946.526762:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755947.297372:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153333120:0@lo:400: 00000100:00100000:0.0:1784755947.297440:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755947.297502:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784755947.297508:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153332992:0@lo:400: 00000100:00100000:0.0:1784755947.297540:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755947.297562:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153333504:0@lo:400: 00000100:00100000:0.0:1784755947.297582:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755947.297622:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153332992 00000100:00100000:0.0:1784755947.297631:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153332992 00000100:00100000:0.0:1784755947.297805:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784755947.297812:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3317:x1871452153332992:12345-0@lo:400: 00000100:00100000:0.0:1784755947.297858:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3317:x1871452153332992:12345-0@lo:400: Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755947.297882:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784755947.297944:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153332992:0@lo:400: 00000100:00100000:3.0:1784755947.298797:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153333248:0@lo:400: 00000100:00100000:3.0:1784755947.298843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755947.298874:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784755947.298880:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153333376:0@lo:400: 00000100:00100000:3.0:1784755947.298903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755947.298933:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333376 00000100:00100000:3.0:1784755947.298938:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333376 00000100:00100000:3.0:1784755947.299111:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784755947.299118:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153333376:12345-0@lo:400: 00000100:00100000:3.0:1784755947.299159:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153333376:12345-0@lo:400: Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755947.299166:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784755947.299181:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784755947.299203:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80856680 x1871452153333376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755947.299215:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153333376:0@lo:400: 00000100:00100000:3.0:1784755947.299850:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333120 00000100:00100000:3.0:1784755947.299856:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333120 00000100:00100000:3.0:1784755947.299884:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333504 00000100:00100000:3.0:1784755947.299887:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333504 00000100:00100000:0.0:1784755947.300058:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333248 00000100:00100000:0.0:1784755947.300063:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333248 00000100:00100000:0.0:1784755947.300084:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784755947.300091:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153333120:12345-0@lo:400: 00000100:00100000:0.0:1784755947.300149:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153333120:12345-0@lo:400: Request processed in 58us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755947.300155:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784755947.300167:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784755947.300173:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153333504:12345-0@lo:400: 00000100:00100000:0.0:1784755947.300202:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153333504:12345-0@lo:400: Request processed in 30us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755947.300207:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784755947.300216:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755947.300221:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153333248:12345-0@lo:400: 00000100:00100000:0.0:1784755947.300251:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153333248:12345-0@lo:400: Request processed in 29us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755947.300256:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784755947.300290:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857480 x1871452153333504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755947.300303:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153333504:0@lo:400: 00010000:00080000:0.0:1784755947.300314:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857b80 x1871452153333120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755947.300339:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153333120:0@lo:400: 00000100:00080000:3.0:1784755947.300395:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784755947.300420:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857800 x1871452153333248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755947.300428:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153333248:0@lo:400: 00000100:00100000:2.0:1784755947.302248:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153333632:0@lo:13: 00000100:00100000:2.0:1784755947.302314:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755947.305685:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333632 00000100:00100000:0.0:1784755947.305701:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333632 00000100:00100000:0.0:1784755947.305770:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784755947.305782:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153333632:12345-0@lo:13: 00002000:00000024:0.0:1784755947.305822:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755947.305905:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153333632:12345-0@lo:13: Request processed in 126us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755947.305925:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784755947.305986:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857b80 x1871452153333632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755947.306015:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153333632:0@lo:13: 00010000:00010000:3.0:1784755947.552779:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784755948.461119:0:7837:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784755948.578835:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755949.603945:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755950.623356:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784755951.390938:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784755951.390946:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf463c1000 from 30 10000000:01000000:2.0:1784755951.390953:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784755951.391062:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.391071:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.391079:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.391098:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153333760:0@lo:101: 00000100:00100000:2.0:1784755951.391164:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755951.391209:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333760 00000100:00100000:0.0:1784755951.391217:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333760 00000100:00100000:2.0:1784755951.391259:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.391260:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784755951.391273:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153333760:12345-0@lo:101: 00010000:00010000:0.0:1784755951.391297:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755951.391311:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3524 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.391333:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.391342:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.391375:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030c00, rc 0) 00000100:00100000:0.0:1784755951.391422:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153333760:12345-0@lo:101: Request processed in 153us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755951.391428:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784755951.391455:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153333760:0@lo:101: 00010000:00010000:2.0:1784755951.391468:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.391477:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.391525:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153333888:0@lo:501: 00000100:00100000:2.0:1784755951.391559:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.391578:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.391686:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153333888 00000100:00100000:0.0:1784755951.391690:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153333888 00000100:00100000:0.0:1784755951.391710:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784755951.391716:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153333888:12345-0@lo:501: 00000100:00100000:0.0:1784755951.392044:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153333888:12345-0@lo:501: Request processed in 326us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755951.392051:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784755951.392072:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153333888:0@lo:501: 00000100:00100000:2.0:1784755951.392098:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334016:0@lo:503: 00000100:00100000:2.0:1784755951.392126:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.392147:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.392160:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334016 00000100:00100000:0.0:1784755951.392164:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334016 00000100:00100000:0.0:1784755951.392195:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784755951.392201:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153334016:12345-0@lo:503: 00000100:00100000:2.0:1784755951.392474:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334016:0@lo:503: 00000100:00100000:2.0:1784755951.393502:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7960:1871452153334144:0@lo:502: 00000100:00100000:0.0:1784755951.393718:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153334016:12345-0@lo:503: Request processed in 1516us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.393726:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755951.393727:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784755951.393800:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.394059:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334144 00000100:00100000:0.0:1784755951.394065:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334144 00000100:00100000:1.0:1784755951.394090:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784755951.394101:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7960:x1871452153334144:12345-0@lo:502: 00000100:00100000:3.0:1784755951.394407:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7960:1871452153334144:0@lo:502: 00000100:00100000:3.0:1784755951.394457:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7960:1871452153334272:0@lo:502: 00000100:00100000:3.0:1784755951.394496:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.394504:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7960:x1871452153334144:12345-0@lo:502: Request processed in 282us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.394512:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784755951.394528:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf240 going to sleep for 11 seconds 00000100:00100000:1.0:1784755951.394542:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334272 00000100:00100000:1.0:1784755951.394547:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334272 00000100:00100000:1.0:1784755951.394611:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784755951.394619:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7960:x1871452153334272:12345-0@lo:502: 00000100:00100000:1.0:1784755951.395054:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:7960:x1871452153334272:12345-0@lo:502: Request processed in 437us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.395061:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784755951.395209:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7960:1871452153334272:0@lo:502: 00000040:00080000:3.0:1784755951.395231:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784755951.395529:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784755951.395549:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784755951.395559:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.395569:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755951.395579:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784755951.395581:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784755951.395584:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784755951.395610:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.395618:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.395628:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.395679:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334400:0@lo:101: 00000100:00100000:2.0:1784755951.395709:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.395735:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.395870:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334400 00000100:00100000:3.0:1784755951.395875:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334400 00000100:00100000:3.0:1784755951.395913:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784755951.395920:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153334400:12345-0@lo:101: 00010000:00010000:3.0:1784755951.395930:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755951.395942:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3532 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.395963:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.395983:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.395991:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74010800, rc 0) 00000100:00100000:3.0:1784755951.396036:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153334400:12345-0@lo:101: Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.396049:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784755951.396085:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334400:0@lo:101: 00010000:00010000:3.0:1784755951.396097:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.396107:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755951.396151:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334528:0@lo:501: 00000100:00100000:3.0:1784755951.396175:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.396187:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf300 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.396197:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334528 00000100:00100000:3.0:1784755951.396199:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334528 00000100:00100000:3.0:1784755951.396213:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784755951.396217:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153334528:12345-0@lo:501: 00000100:00100000:3.0:1784755951.396454:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153334528:12345-0@lo:501: Request processed in 234us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.396462:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784755951.396493:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334528:0@lo:501: 00000100:00100000:3.0:1784755951.396516:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334656:0@lo:503: 00000100:00100000:3.0:1784755951.396549:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.396561:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf300 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.396572:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334656 00000100:00100000:3.0:1784755951.396576:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334656 00000100:00100000:3.0:1784755951.396592:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784755951.396598:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153334656:12345-0@lo:503: 00000100:00100000:3.0:1784755951.396822:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153334656:12345-0@lo:503: Request processed in 223us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.396828:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784755951.396862:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153334656:0@lo:503: 00000100:00100000:3.0:1784755951.397032:0:7961:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7961:1871452153334784:0@lo:502: 00000100:00100000:3.0:1784755951.397066:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.397091:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334784 00000100:00100000:3.0:1784755951.397095:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334784 00000100:00100000:3.0:1784755951.397112:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784755951.397118:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:7961:x1871452153334784:12345-0@lo:502: 00000100:00100000:3.0:1784755951.397280:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:7961:x1871452153334784:12345-0@lo:502: Request processed in 161us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.397286:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784755951.397384:0:7961:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.397397:0:7961:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7961:1871452153334784:0@lo:502: 00000020:01000000:3.0:1784755951.397416:0:7961:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755951.397423:0:7961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755951.397426:0:7961:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784755951.397431:0:7961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755951.397432:0:7961:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784755951.397446:0:7961:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7961:1871452153334912:0@lo:502: 00000100:00100000:3.0:1784755951.397477:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.397496:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153334912 00000100:00100000:3.0:1784755951.397499:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153334912 00000100:00100000:3.0:1784755951.397514:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784755951.397519:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:7961:x1871452153334912:12345-0@lo:502: 00000100:00100000:3.0:1784755951.397626:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:7961:x1871452153334912:12345-0@lo:502: Request processed in 105us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.397632:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784755951.397695:0:7961:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.397707:0:7961:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7961:1871452153334912:0@lo:502: 00000020:01000000:3.0:1784755951.397727:0:7961:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755951.397731:0:7961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755951.397733:0:7961:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784755951.397736:0:7961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1784755951.397828:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784755951.397844:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784755951.397853:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.397862:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755951.397870:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784755951.397872:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf4549c800 from 30 10000000:01000000:2.0:1784755951.397874:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784755951.397894:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.397901:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.397910:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.397924:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335040:0@lo:101: 00000100:00100000:2.0:1784755951.397950:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.397990:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.398046:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335040 00000100:00100000:0.0:1784755951.398051:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335040 00000100:00100000:1.0:1784755951.398085:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784755951.398097:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153335040:12345-0@lo:101: 00010000:00010000:1.0:1784755951.398107:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755951.398119:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3540 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.398141:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.398151:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.398161:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82151e00, rc 0) 00000100:00100000:1.0:1784755951.398262:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335040:12345-0@lo:101: Request processed in 167us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.398269:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784755951.398318:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335040:0@lo:101: 00010000:00010000:1.0:1784755951.398340:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.398349:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755951.398392:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335168:0@lo:501: 00000100:00100000:1.0:1784755951.398418:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.398442:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.398457:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335168 00000100:00100000:2.0:1784755951.398462:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335168 00000100:00100000:2.0:1784755951.398498:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784755951.398504:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335168:12345-0@lo:501: 00000100:00100000:2.0:1784755951.398711:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335168:12345-0@lo:501: Request processed in 207us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.398718:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784755951.398782:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335168:0@lo:501: 00000100:00100000:1.0:1784755951.398809:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335296:0@lo:503: 00000100:00100000:1.0:1784755951.399367:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.399400:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.399444:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335296 00000100:00100000:0.0:1784755951.399449:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335296 00000100:00100000:0.0:1784755951.399478:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784755951.399485:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335296:12345-0@lo:503: 00000100:00100000:0.0:1784755951.399630:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335296:12345-0@lo:503: Request processed in 145us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.399672:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335296:0@lo:503: 00000100:00100000:0.0:1784755951.399672:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784755951.400276:0:7962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7962:1871452153335424:0@lo:502: 00000100:00100000:1.0:1784755951.400312:0:7962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.400337:0:7962:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.400387:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335424 00000100:00100000:0.0:1784755951.400391:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335424 00000100:00100000:0.0:1784755951.400447:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784755951.400454:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:7962:x1871452153335424:12345-0@lo:502: 00000100:00100000:0.0:1784755951.400608:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:7962:x1871452153335424:12345-0@lo:502: Request processed in 154us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755951.400615:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784755951.400696:0:7962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7962:1871452153335424:0@lo:502: 00000100:00100000:3.0:1784755951.400732:0:7962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7962:1871452153335552:0@lo:502: 00000100:00100000:3.0:1784755951.400759:0:7962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.403176:0:7962:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755951.403577:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335552 00000100:00100000:1.0:1784755951.403586:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335552 00000100:00100000:1.0:1784755951.403632:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784755951.403710:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:7962:x1871452153335552:12345-0@lo:502: 00000100:00100000:1.0:1784755951.404059:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:7962:x1871452153335552:12345-0@lo:502: Request processed in 351us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.404066:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784755951.404194:0:7962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7962:1871452153335552:0@lo:502: 00000040:00080000:3.0:1784755951.404228:0:7962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784755951.404522:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784755951.404546:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784755951.404562:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.404573:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755951.404582:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784755951.404585:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8fcf4549c800 from 5 10000000:01000000:1.0:1784755951.404588:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784755951.404618:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.404626:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.404741:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755951.404760:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335680:0@lo:101: 00000100:00100000:1.0:1784755951.404795:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.404859:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1784755951.404898:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335680 00000100:00100000:0.0:1784755951.404903:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335680 00000100:00100000:0.0:1784755951.404964:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784755951.404981:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153335680:12345-0@lo:101: 00010000:00010000:0.0:1784755951.404990:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755951.405004:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40031e00/0x8f2fc1536a2c3555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c354e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.405022:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40031e00/0x8f2fc1536a2c3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c354e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.405031:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40031e00/0x8f2fc1536a2c3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c354e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755951.405039:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40031e00, rc 0) 00000100:00100000:0.0:1784755951.405096:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153335680:12345-0@lo:101: Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755951.405102:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784755951.405158:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335680:0@lo:101: 00010000:00010000:1.0:1784755951.405169:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3555 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755951.405176:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3555 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755951.405217:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335808:0@lo:256: 00000100:00100000:1.0:1784755951.405251:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.405515:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b1a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.405572:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335808 00000100:00100000:3.0:1784755951.405576:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335808 00000100:00100000:3.0:1784755951.405598:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784755951.405604:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153335808:12345-0@lo:256: 20000000:01000000:3.0:1784755951.405618:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784755951.405655:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784755951.405658:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784755951.405854:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153335808:12345-0@lo:256: Request processed in 249us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.405860:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784755951.405891:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335808:0@lo:256: 10000000:01000000:3.0:1784755951.405939:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784755951.405945:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3555 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.405953:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82151600/0x8f2fc1536a2c354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3555 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755951.405960:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784755951.405962:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784755951.405964:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784755951.406014:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406020:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406027:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755951.406039:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335936:0@lo:101: 00000100:00100000:3.0:1784755951.406064:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.406083:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.406092:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153335936 00000100:00100000:3.0:1784755951.406095:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153335936 00000100:00100000:3.0:1784755951.406111:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784755951.406116:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153335936:12345-0@lo:101: 00010000:00010000:3.0:1784755951.406122:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755951.406129:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c355c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406152:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406159:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406166:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011a00, rc 0) 00000100:00100000:3.0:1784755951.406191:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153335936:12345-0@lo:101: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.406197:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784755951.406220:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153335936:0@lo:101: 00010000:00010000:3.0:1784755951.406230:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755951.406237:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755951.406272:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153336064:0@lo:501: 00000100:00100000:3.0:1784755951.406293:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.406305:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.406315:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336064 00000100:00100000:3.0:1784755951.406318:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336064 00000100:00100000:3.0:1784755951.406332:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784755951.406338:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153336064:12345-0@lo:501: 00000100:00100000:3.0:1784755951.406865:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153336064:12345-0@lo:501: Request processed in 526us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.406873:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784755951.406961:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153336064:0@lo:501: 00000100:00100000:0.0:1784755951.407007:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153336192:0@lo:503: 00000100:00100000:0.0:1784755951.407043:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755951.407071:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80b903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755951.407116:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336192 00000100:00100000:3.0:1784755951.407121:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336192 00000100:00100000:3.0:1784755951.407189:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784755951.407198:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153336192:12345-0@lo:503: 00000100:00100000:3.0:1784755951.407391:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153336192:12345-0@lo:503: Request processed in 184us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.407397:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784755951.407659:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153336192:0@lo:503: 00000100:00100000:0.0:1784755951.407948:0:7963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7963:1871452153336320:0@lo:502: 00000100:00100000:0.0:1784755951.407991:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755951.408016:0:7963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80b90300 going to sleep for 11 seconds 00000100:00100000:1.0:1784755951.408061:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336320 00000100:00100000:1.0:1784755951.408066:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336320 00000100:00100000:1.0:1784755951.408089:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784755951.408095:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:7963:x1871452153336320:12345-0@lo:502: 00000100:00100000:1.0:1784755951.408297:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:7963:x1871452153336320:12345-0@lo:502: Request processed in 201us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755951.408304:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784755951.408395:0:7963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7963:1871452153336320:0@lo:502: 00000020:01000000:0.0:1784755951.408418:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784755951.408426:0:7963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784755951.408432:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755951.408435:0:7963:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784755951.408439:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784755951.408442:0:7963:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.108@tcp to nid 0x20000c0a8ca6c (192.168.202.108@tcp) 00000020:01000000:0.0:1784755951.408464:0:7963:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784755951.408467:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784755951.408482:0:7963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fcf7b9e4d40) 00000020:00000080:0.0:1784755951.408505:0:7963:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784755951.408510:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784755951.408577:0:7963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784755951.408582:0:7963:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784755951.408588:0:7963:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f2fc1536a2c3571 00010000:00080000:0.0:1784755951.408615:0:7963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fce44a92800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.108@tcp at head 00010000:00010000:0.0:1784755951.408864:0:7963:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1784755951.409168:0:7963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784755951.409178:0:7963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784755951.409698:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755951.409917:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755951.409980:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784755951.410046:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1784755951.413962:0:7964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784755951.413978:0:7964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784755951.421034:0:7963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784755951.421050:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784755951.421102:0:7963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784755951.421124:0:7963:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f2fc1536a2c3578 00000100:00080000:3.0:1784755951.421135:0:7963:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784755951.421141:0:7963:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fce44a92800 using connection 192.168.202.108@tcp/0@lo 00000100:00100000:3.0:1784755951.421180:0:7963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fcf60434380 x1871452153336448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784755951.421209:0:7963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784755951.421266:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755951.421270:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755951.421273:0:7963:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784755951.421276:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755951.421280:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755951.421282:0:7963:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784755951.421285:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755951.421287:0:7963:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784755951.421314:0:7963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7963:1871452153336576:0@lo:502: 00000100:00100000:0.0:1784755951.421816:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1871452153336448:0@lo:8: 00000100:00100000:0.0:1784755951.421859:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755951.421957:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336448 00000100:00100000:1.0:1784755951.421965:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336448 00000100:00100000:1.0:1784755951.422017:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755951.422026:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1871452153336448:12345-0@lo:8: 00010000:00080000:1.0:1784755951.422051:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1784755951.422088:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f2fc1536a2c357f 00002000:00100000:1.0:1784755951.422101:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fcf46356800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784755951.422106:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1784755951.422110:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784755951.422232:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784755951.422368:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1784755951.422556:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153336704:0@lo:400: 00000100:00100000:2.0:1784755951.422592:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.422613:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755951.422618:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153336832:0@lo:400: 00000100:00100000:2.0:1784755951.422666:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.422693:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153336960:0@lo:400: 00000100:00100000:2.0:1784755951.422716:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.422732:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784755951.422737:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153337088:0@lo:400: 00000100:00100000:2.0:1784755951.422756:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.422780:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336704 00000100:00100000:2.0:1784755951.422785:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336704 00000100:00100000:2.0:1784755951.422809:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336832 00000100:00100000:2.0:1784755951.422811:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336832 00000100:00100000:2.0:1784755951.422830:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337088 00000100:00100000:2.0:1784755951.422833:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337088 00000100:00100000:2.0:1784755951.422846:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755951.422852:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153336704:12345-0@lo:400: 00000100:00100000:2.0:1784755951.422900:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153336704:12345-0@lo:400: Request processed in 48us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.422907:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755951.422920:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755951.422926:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153336832:12345-0@lo:400: 00000100:00100000:2.0:1784755951.422961:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153336832:12345-0@lo:400: Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.422967:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755951.422996:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755951.423002:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153337088:12345-0@lo:400: 00000100:00100000:2.0:1784755951.423034:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153337088:12345-0@lo:400: Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.423040:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755951.423057:0:6591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784755951.423064:0:6591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1784755951.423080:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784755951.423104:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c6e9f80 x1871452153336832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.423118:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153336832:0@lo:400: 00010000:00080000:2.0:1784755951.423129:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c6e8000 x1871452153336704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.423136:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153336704:0@lo:400: 00010000:00080000:2.0:1784755951.423160:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c17ea00 x1871452153337088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.423169:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153337088:0@lo:400: 00000100:00100000:2.0:1784755951.423289:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336960 00000100:00100000:2.0:1784755951.423293:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336960 00000100:00100000:2.0:1784755951.423317:0:6591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784755951.423324:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755951.423329:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153336960:12345-0@lo:400: 00000100:00100000:2.0:1784755951.423372:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153336960:12345-0@lo:400: Request processed in 43us (655us total) trans 0 rc 0/0 00000100:00080000:1.0:1784755951.423476:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8fcf46352800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784755951.423518:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1871452153336448:12345-0@lo:8: Request processed in 1492us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.423756:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.423907:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153336576 00000100:00100000:3.0:1784755951.423911:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153336576 00000100:00100000:3.0:1784755951.423937:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784755951.423951:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:7963:x1871452153336576:12345-0@lo:502: 00000100:00100000:3.0:1784755951.424186:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:7963:x1871452153336576:12345-0@lo:502: Request processed in 235us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755951.424194:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784755951.424501:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784755951.424522:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784755951.424546:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c6ea680 x1871452153336960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.424557:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153336960:0@lo:400: 00000100:00100000:2.0:1784755951.424682:0:7963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42faf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.424697:0:7963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:7963:1871452153336576:0@lo:502: 00000020:01000000:2.0:1784755951.424724:0:7963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755951.424731:0:7963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755951.424733:0:7963:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784755951.424738:0:7963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1784755951.424800:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784755951.424820:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784755951.424829:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.424841:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755951.424851:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784755951.424853:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8fcf46313380 from 1 10000000:01000000:2.0:1784755951.424856:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784755951.424884:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.424892:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.424908:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.424925:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153337216:0@lo:101: 00000100:00100000:2.0:1784755951.424958:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.424984:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744840 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.424999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337216 00000100:00100000:2.0:1784755951.425003:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337216 00000100:00100000:2.0:1784755951.425027:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784755951.425034:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153337216:12345-0@lo:101: 00010000:00010000:2.0:1784755951.425044:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755951.425056:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3586 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.425077:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.425087:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.425096:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270c00, rc 0) 00000100:00100000:2.0:1784755951.425125:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153337216:12345-0@lo:101: Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.425130:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784755951.425158:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153337216:0@lo:101: 00010000:00010000:2.0:1784755951.425169:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.425188:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755951.425231:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153337344:0@lo:501: 00000100:00100000:2.0:1784755951.425255:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.425267:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744840 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.425277:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337344 00000100:00100000:2.0:1784755951.425281:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337344 00000100:00100000:2.0:1784755951.425301:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784755951.425306:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153337344:12345-0@lo:501: 00000100:00100000:2.0:1784755951.425505:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153337344:12345-0@lo:501: Request processed in 198us (249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784755951.425512:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784755951.425540:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153337344:0@lo:501: 10000000:01000000:2.0:1784755951.425563:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784755951.425568:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755951.425575:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784755951.425751:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf60434380 x1871452153336448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784755961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755951.425761:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784755951.425768:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784755951.425775:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784755951.425780:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784755951.425783:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fce44a92800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784755951.425805:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784755951.425811:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1871452153336448:0@lo:8: 00000100:00100000:1.0:1784755951.429789:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1784755951.429828:0:7964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784755951.429927:0:7964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193543289189ns, next at 0ns, rc = 0 00000004:00080000:0.0:1784755951.469059:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784755951.469302:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755951.469323:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153337472:0@lo:13: 00000100:00100000:2.0:1784755951.469395:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.469456:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337472 00000100:00100000:2.0:1784755951.469463:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337472 00000100:00100000:2.0:1784755951.469524:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755951.469532:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1871452153337472:12345-0@lo:13: 00002000:00000024:2.0:1784755951.469563:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1784755951.469606:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1871452153337472:12345-0@lo:13: Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.469613:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784755951.469633:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784755951.469687:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c17ea00 x1871452153337472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.469705:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153337472:0@lo:13: 00000004:00080000:2.0:1784755951.469721:0:7965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784755951.469741:0:7965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337600:0@lo:7: 00000100:00100000:2.0:1784755951.469765:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.469785:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337600 00000100:00100000:2.0:1784755951.469787:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337600 00000100:00100000:2.0:1784755951.469810:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755951.469815:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7965:x1871452153337600:12345-0@lo:7: 00000100:00100000:3.0:1784755951.472708:0:7965:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744b40 going to sleep for 11 seconds 00002000:00080000:2.0:1784755951.482492:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1784755951.482500:0:6591:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784755951.482657:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7965:x1871452153337600:12345-0@lo:7: Request processed in 12815us (12866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.482668:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784755951.483309:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c17ea00 x1871452153337600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784755967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755951.483324:0:7965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337600:0@lo:7: 00000004:00080000:3.0:1784755951.483338:0:7965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784755951.483377:0:7965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337728:0@lo:5: 00000100:00100000:3.0:1784755951.483417:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755951.483465:0:7965:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42fafb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.483513:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337728 00000100:00100000:2.0:1784755951.483519:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337728 00000100:00100000:2.0:1784755951.483565:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755951.483574:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7965:x1871452153337728:12345-0@lo:5: 00002000:00080000:2.0:1784755951.483599:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784755951.483610:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784755951.483874:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7965:x1871452153337728:12345-0@lo:5: Request processed in 300us (454us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784755951.483881:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784755951.483909:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf60436d80 x1871452153337728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.483920:0:7965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337728:0@lo:5: 00000004:00080000:2.0:1784755951.483928:0:7965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784755951.483951:0:7965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337856:0@lo:700: 00000100:00100000:2.0:1784755951.483985:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.484011:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337856 00000100:00100000:2.0:1784755951.484015:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337856 00000100:00100000:2.0:1784755951.484039:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755951.484046:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7965:x1871452153337856:12345-0@lo:700: 00000100:00100000:2.0:1784755951.484086:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c17fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1871452153337984:0@lo:700: 00000100:00100000:2.0:1784755951.484111:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.484126:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.484142:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153337984 00000100:00100000:2.0:1784755951.484145:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153337984 00000100:00100000:2.0:1784755951.484172:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755951.484177:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1871452153337984:12345-0@lo:700: 00000100:00100000:2.0:1784755951.485143:0:7965:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807449c0 going to sleep for 11 seconds 40000000:02000000:2.0:1784755951.530712:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784755951.539952:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1871452153337984:12345-0@lo:700: Request processed in 55767us (55834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.539965:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784755951.540039:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c17fb80 x1871452153337984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784755967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755951.540055:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1871452153337984:0@lo:700: 40000000:02000000:2.0:1784755951.540067:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1784755951.594177:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784755951.594203:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1784755951.595301:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7965:x1871452153337856:12345-0@lo:700: Request processed in 111240us (111300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755951.595314:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784755951.595467:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c17d880 x1871452153337856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784755967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755951.595479:0:7965:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784755951.595494:0:7965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c17d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153337856:0@lo:700: 00000004:02000040:1.0:1784755951.614470:0:7965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1784755951.617609:0:7965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153338112:0@lo:5: 00000100:00100000:1.0:1784755951.617779:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755951.617817:0:7966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338112 00000100:00100000:2.0:1784755951.617826:0:7966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338112 00000100:00100000:1.0:1784755951.617831:0:7965:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf456e6180 going to sleep for 11 seconds 00000100:00100000:2.0:1784755951.617885:0:7966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755951.617894:0:7966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7965:x1871452153338112:12345-0@lo:5: 00002000:00080000:3.0:1784755951.621451:0:7966:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784755951.621474:0:7966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784755951.624034:0:7966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7965:x1871452153338112:12345-0@lo:5: Request processed in 6135us (6248us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784755951.624044:0:7966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784755951.624117:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bc0c380 x1871452153338112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755951.624134:0:7965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1871452153338112:0@lo:5: 00000004:00080000:1.0:1784755951.624149:0:7965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1784755951.649939:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755952.414863:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153338240:0@lo:13: 00000100:00100000:2.0:1784755952.414951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755952.421333:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338240 00000100:00100000:0.0:1784755952.421346:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338240 00000100:00100000:0.0:1784755952.421403:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755952.421416:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153338240:12345-0@lo:13: 00002000:00000024:0.0:1784755952.421455:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755952.421548:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153338240:12345-0@lo:13: Request processed in 135us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755952.421557:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784755952.421591:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857480 x1871452153338240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755952.421614:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153338240:0@lo:13: 00010000:00010000:0.0:1784755952.671995:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784755952.690808:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1784755953.695740:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755954.083506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755954.083683:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136538496 00000100:00100000:0.0:1784755954.083693:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136538496 00000100:00100000:0.0:1784755954.083744:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 110 00000100:00100000:0.0:1784755954.083752:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1871452136538496:12345-192.168.202.8@tcp:250: 00010000:00080000:0.0:1784755954.083792:0:5791:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bce9a21a-c6b6-4a15-be59-725c4253efd6@192.168.202.8@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1784755954.083829:0:5791:0:(genops.c:1406:class_connect()) connect: client bce9a21a-c6b6-4a15-be59-725c4253efd6, cookie 0x8f2fc1536a2c3594 00000100:00080000:0.0:1784755954.083991:0:5791:0:(import.c:65:import_set_state_nolock()) ffff8fce44a87800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784755954.084058:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+5:2353:x1871452136538496:12345-192.168.202.8@tcp:250: Request processed in 305us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.084067:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 110 00000100:00100000:1.0:1784755954.096249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755954.096439:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136538368 00000100:00100000:3.0:1784755954.096449:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136538368 00000100:00100000:3.0:1784755954.096513:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 111 00000100:00100000:3.0:1784755954.096525:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+5:5555:x1871452136538368:12345-192.168.202.8@tcp:101: 00010000:00010000:3.0:1784755954.096558:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755954.096577:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2b88 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.096606:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.096618:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.096628:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011400, rc 0) 00000100:00100000:3.0:1784755954.096709:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+6:5555:x1871452136538368:12345-192.168.202.8@tcp:101: Request processed in 186us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755954.096715:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 111 00000100:00100000:3.0:1784755954.101513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.104903:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136538624 00000100:00100000:2.0:1784755954.104918:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136538624 00000100:00100000:2.0:1784755954.105031:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 112 00000100:00100000:2.0:1784755954.105058:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+6:5555:x1871452136538624:12345-192.168.202.8@tcp:501: 00000100:00100000:2.0:1784755954.105610:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+6:5555:x1871452136538624:12345-192.168.202.8@tcp:501: Request processed in 552us (4106us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784755954.105619:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 112 00000100:00100000:2.0:1784755954.111969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755954.112077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136538752 00000100:00100000:0.0:1784755954.112087:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136538752 00000100:00100000:0.0:1784755954.112148:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 113 00000100:00100000:0.0:1784755954.112158:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+6:5555:x1871452136538752:12345-192.168.202.8@tcp:101: 00010000:00010000:0.0:1784755954.112176:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755954.112194:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2b8f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.112225:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.112238:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.112248:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030a00, rc 0) 00000100:00100000:0.0:1784755954.112314:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+7:5555:x1871452136538752:12345-192.168.202.8@tcp:101: Request processed in 158us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.112321:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 113 00000100:00100000:1.0:1784755954.116262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.116410:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136538880 00000100:00100000:2.0:1784755954.116420:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136538880 00000100:00100000:2.0:1784755954.116480:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 114 00000100:00100000:2.0:1784755954.116491:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+7:5555:x1871452136538880:12345-192.168.202.8@tcp:501: 00000100:00100000:2.0:1784755954.116875:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5555:x1871452136538880:12345-192.168.202.8@tcp:501: Request processed in 385us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.116884:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 114 00000100:00100000:1.0:1784755954.118818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755954.118888:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539008 00000100:00100000:3.0:1784755954.118897:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539008 00000100:00100000:3.0:1784755954.118958:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 115 00000100:00100000:3.0:1784755954.118969:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5555:x1871452136539008:12345-192.168.202.8@tcp:503: 00000100:00100000:3.0:1784755954.119362:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5555:x1871452136539008:12345-192.168.202.8@tcp:503: Request processed in 394us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755954.119370:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 115 00000100:00100000:3.0:1784755954.122198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755954.122401:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539136 00000100:00100000:0.0:1784755954.122411:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539136 00000100:00100000:0.0:1784755954.122463:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 116 00000100:00100000:0.0:1784755954.122473:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5574:x1871452136539136:12345-192.168.202.8@tcp:502: 00000100:00100000:0.0:1784755954.122842:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5574:x1871452136539136:12345-192.168.202.8@tcp:502: Request processed in 370us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.122849:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 116 00000100:00100000:1.0:1784755954.158544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.158682:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539264 00000100:00100000:2.0:1784755954.158693:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539264 00000100:00100000:2.0:1784755954.158736:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 117 00000100:00100000:2.0:1784755954.158744:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5574:x1871452136539264:12345-192.168.202.8@tcp:502: 00000100:00100000:2.0:1784755954.159199:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5574:x1871452136539264:12345-192.168.202.8@tcp:502: Request processed in 454us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.159208:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 117 00000100:00100000:1.0:1784755954.168627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755954.168729:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539392 00000100:00100000:3.0:1784755954.168738:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539392 00000100:00100000:3.0:1784755954.168792:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 118 00000100:00100000:3.0:1784755954.168802:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5555:x1871452136539392:12345-192.168.202.8@tcp:101: 00010000:00010000:3.0:1784755954.168833:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755954.168850:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c35a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bb9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.168876:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bb9 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.168887:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011c00/0x8f2fc1536a2c35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bb9 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755954.168896:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011c00, rc 0) 00000100:00100000:3.0:1784755954.168965:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5555:x1871452136539392:12345-192.168.202.8@tcp:101: Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755954.168972:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 118 00000100:00100000:3.0:1784755954.174469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.174684:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539520 00000100:00100000:2.0:1784755954.174693:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539520 00000100:00100000:2.0:1784755954.174748:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 119 00000100:00100000:2.0:1784755954.174759:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5555:x1871452136539520:12345-192.168.202.8@tcp:256: 20000000:01000000:2.0:1784755954.174784:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784755954.174808:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784755954.174812:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784755954.174815:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784755954.174818:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1784755954.180024:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5555:x1871452136539520:12345-192.168.202.8@tcp:256: Request processed in 5254us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.180039:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 119 00000100:00100000:1.0:1784755954.197779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755954.197896:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539648 00000100:00100000:0.0:1784755954.197905:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539648 00000100:00100000:0.0:1784755954.197992:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 120 00000100:00100000:0.0:1784755954.198003:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5555:x1871452136539648:12345-192.168.202.8@tcp:101: 00010000:00010000:0.0:1784755954.198024:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755954.198061:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bc0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.198098:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.198110:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755954.198120:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030e00, rc 0) 00000100:00100000:0.0:1784755954.198174:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5555:x1871452136539648:12345-192.168.202.8@tcp:101: Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.198181:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 120 00000100:00100000:3.0:1784755954.204288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.204665:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539776 00000100:00100000:2.0:1784755954.204675:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539776 00000100:00100000:2.0:1784755954.204738:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 121 00000100:00100000:2.0:1784755954.204748:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5555:x1871452136539776:12345-192.168.202.8@tcp:501: 00000100:00100000:2.0:1784755954.208021:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5555:x1871452136539776:12345-192.168.202.8@tcp:501: Request processed in 3262us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.208037:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 121 00000100:00100000:1.0:1784755954.215902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755954.216034:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136539904 00000100:00100000:3.0:1784755954.216054:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136539904 00000100:00100000:3.0:1784755954.216109:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 122 00000100:00100000:3.0:1784755954.216119:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5555:x1871452136539904:12345-192.168.202.8@tcp:503: 00000100:00100000:2.0:1784755954.217052:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5555:x1871452136539904:12345-192.168.202.8@tcp:503: Request processed in 916us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.217063:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 122 00000100:00100000:1.0:1784755954.222836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755954.222967:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540032 00000100:00100000:2.0:1784755954.222978:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540032 00000100:00100000:2.0:1784755954.223083:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 123 00000100:00100000:2.0:1784755954.223094:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5578:x1871452136540032:12345-192.168.202.8@tcp:502: 00000100:00100000:2.0:1784755954.223728:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5578:x1871452136540032:12345-192.168.202.8@tcp:502: Request processed in 632us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755954.223738:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 123 00000100:00100000:3.0:1784755954.226551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755954.228508:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540160 00000100:00100000:0.0:1784755954.228522:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540160 00000100:00100000:0.0:1784755954.228570:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 124 00000100:00100000:0.0:1784755954.228581:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5578:x1871452136540160:12345-192.168.202.8@tcp:502: 00000100:00100000:0.0:1784755954.228837:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5578:x1871452136540160:12345-192.168.202.8@tcp:502: Request processed in 257us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.228854:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 124 00000100:00100000:0.0:1784755954.232874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755954.233714:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540288 00000100:00100000:3.0:1784755954.233726:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540288 00000100:00100000:3.0:1784755954.233786:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 4 00000100:00100000:3.0:1784755954.233794:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1871452136540288:12345-192.168.202.8@tcp:38: 00010000:00080000:3.0:1784755954.233823:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417@192.168.202.8@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1784755954.233868:0:5797:0:(genops.c:1406:class_connect()) connect: client 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417, cookie 0x8f2fc1536a2c35b7 00000004:00100000:3.0:1784755954.233910:0:5797:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1784755954.233916:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1784755954.297335:0:5797:0:(import.c:65:import_set_state_nolock()) ffff8fce44a81000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784755954.297660:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2353:x1871452136540288:12345-192.168.202.8@tcp:38: Request processed in 63861us (64790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755954.297672:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 4 00010000:00010000:0.0:1784755954.719182:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755955.304839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755955.304884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755955.304959:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540416 00000100:00100000:0.0:1784755955.304971:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540416 00000100:00100000:0.0:1784755955.305052:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540544 00000100:00100000:0.0:1784755955.305056:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540544 00000100:00100000:0.0:1784755955.305086:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:0.0:1784755955.305096:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:0:x1871452136540416:12345-192.168.202.8@tcp:41: 00000100:00080000:3.0:1784755955.305116:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1784755955.305142:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784755955.305218:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:0:x1871452136540416:12345-192.168.202.8@tcp:41: Request processed in 123us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755955.305226:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:0.0:1784755955.305246:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00100000:0.0:1784755955.305254:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136540544:12345-192.168.202.8@tcp:41: 00000004:00000024:0.0:1784755955.305267:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784755955.305292:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136540544:12345-192.168.202.8@tcp:41: Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755955.305298:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00100000:3.0:1784755955.307087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755955.307142:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540672 00000100:00100000:2.0:1784755955.307150:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540672 00000100:00100000:2.0:1784755955.307242:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 7 00000100:00100000:2.0:1784755955.307251:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136540672:12345-192.168.202.8@tcp:40: 00000100:00100000:2.0:1784755955.307329:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136540672:12345-192.168.202.8@tcp:40: Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755955.307336:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 7 00000100:00100000:2.0:1784755955.308814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755955.309039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755955.309169:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540800 00000100:00100000:1.0:1784755955.309175:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540800 00000100:00100000:1.0:1784755955.309218:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136540928 00000100:00100000:1.0:1784755955.309221:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136540928 00000100:00100000:1.0:1784755955.309239:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:2.0:1784755955.309245:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00100000:1.0:1784755955.309247:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871452136540800:12345-192.168.202.8@tcp:8: 00000100:00100000:2.0:1784755955.309250:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1871452136540928:12345-192.168.202.8@tcp:8: 00010000:00080000:2.0:1784755955.309275:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417@192.168.202.8@tcp t0 exp 0000000000000000 cur 197 last 0 00010000:00080000:1.0:1784755955.309276:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417@192.168.202.8@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1784755955.309303:0:6591:0:(genops.c:1406:class_connect()) connect: client 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417, cookie 0x8f2fc1536a2c35c5 00000020:00000080:1.0:1784755955.309303:0:6589:0:(genops.c:1406:class_connect()) connect: client 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417, cookie 0x8f2fc1536a2c35be 00002000:00100000:1.0:1784755955.309315:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417/ffff8fcf46352000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784755955.309338:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1784755955.309431:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417/ffff8fce46f3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784755955.309445:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784755955.309682:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1784755955.309682:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784755955.309708:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8fce46f3c000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784755955.309708:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8fcf46351800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755955.309770:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2353:x1871452136540928:12345-192.168.202.8@tcp:8: Request processed in 517us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755955.309778:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00100000:1.0:1784755955.309860:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2353:x1871452136540800:12345-192.168.202.8@tcp:8: Request processed in 613us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755955.309865:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:2.0:1784755955.312106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755955.312167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755955.312243:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541184 00000100:00100000:0.0:1784755955.312251:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541184 00000100:00100000:0.0:1784755955.312342:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 125 00000100:00100000:0.0:1784755955.312366:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136541184:12345-192.168.202.8@tcp:400: 00000100:00100000:0.0:1784755955.312435:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136541184:12345-192.168.202.8@tcp:400: Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755955.312440:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 125 00000100:00100000:3.0:1784755955.312574:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541056 00000100:00100000:3.0:1784755955.312577:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541056 00000100:00100000:3.0:1784755955.312598:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 0 00000100:00100000:3.0:1784755955.312602:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136541056:12345-192.168.202.8@tcp:33: 00000004:00080000:2.0:1784755955.328276:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15608us 00000004:00200000:3.0:1784755955.362889:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784755955.363083:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5555:x1871452136541056:12345-192.168.202.8@tcp:33: Request processed in 50474us (50977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755955.363094:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 0 00000100:00100000:2.0:1784755955.526084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755955.526223:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541312 00000100:00100000:1.0:1784755955.526242:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541312 00000100:00100000:1.0:1784755955.526298:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:1.0:1784755955.526305:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5596:x1871452136541312:12345-192.168.202.8@tcp:101: 00010000:00010000:1.0:1784755955.526325:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755955.526391:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82151000/0x8f2fc1536a2c35cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bea expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526448:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526458:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526470:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784755955.526678:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784755955.526682:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784755955.526747:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526769:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82151000/0x8f2fc1536a2c35cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bea expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526782:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bea expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755955.526788:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:1.0:1784755955.526790:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784755955.526793:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82150a00, rc 0) 00000100:00100000:1.0:1784755955.526846:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:5596:x1871452136541312:12345-192.168.202.8@tcp:101: Request processed in 540us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755955.526852:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 8 00010000:00010000:3.0:1784755955.742859:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755956.510825:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153338368:0@lo:400: 00000100:00100000:2.0:1784755956.510903:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755956.511107:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338368 00000100:00100000:3.0:1784755956.511115:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338368 00000100:00100000:3.0:1784755956.511164:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784755956.511174:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153338368:12345-0@lo:400: 00000100:00100000:2.0:1784755956.512278:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153338880:0@lo:400: 00000100:00100000:2.0:1784755956.512327:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755956.518617:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153338496:0@lo:13: 00000100:00100000:1.0:1784755956.518720:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755956.518823:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338496 00000100:00100000:1.0:1784755956.518831:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338496 00000100:00100000:1.0:1784755956.518904:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755956.518913:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153338496:12345-0@lo:13: 00002000:00000024:1.0:1784755956.518973:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755956.519019:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153338496:12345-0@lo:13: Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755956.519037:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784755956.519090:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bc0c000 x1871452153338496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755956.519099:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784755956.519121:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153338496:0@lo:13: 00000100:00100000:1.0:1784755956.519157:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338880 00000100:00100000:1.0:1784755956.519161:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338880 00000100:00100000:1.0:1784755956.519188:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755956.519195:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153338880:12345-0@lo:400: 00000100:00100000:1.0:1784755956.519230:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153338880:12345-0@lo:400: Request processed in 35us (6902us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755956.519236:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755956.519275:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153338752:0@lo:400: 00000100:00100000:1.0:1784755956.519314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755956.519336:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784755956.519342:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153338624:0@lo:400: 00000100:00100000:1.0:1784755956.519362:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755956.519390:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338752 00000100:00100000:1.0:1784755956.519393:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338752 00000100:00100000:1.0:1784755956.519418:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153338624 00000100:00100000:1.0:1784755956.519420:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153338624 00000100:00100000:1.0:1784755956.519433:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784755956.519438:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153338752:12345-0@lo:400: 00000100:00100000:1.0:1784755956.519472:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153338752:12345-0@lo:400: Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755956.519478:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784755956.519489:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784755956.519495:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153338624:12345-0@lo:400: 00000100:00100000:1.0:1784755956.519530:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153338624:12345-0@lo:400: Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755956.519536:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784755956.519560:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153338624:0@lo:400: 00000100:00100000:1.0:1784755956.519570:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153338752:0@lo:400: 00000100:00100000:3.0:1784755956.519603:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153338368:12345-0@lo:400: Request processed in 8429us (8697us total) trans 0 rc 0/0 00000100:00080000:1.0:1784755956.519606:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784755956.519611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755956.519612:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1784755956.519613:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784755956.520610:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153339008:0@lo:400: 00000100:00100000:2.0:1784755956.522266:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153338368:0@lo:400: 00010000:00080000:2.0:1784755956.522318:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80856680 x1871452153338880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755956.522330:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153338880:0@lo:400: 00000100:00100000:1.0:1784755956.522534:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755956.522617:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339008 00000100:00100000:2.0:1784755956.522624:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339008 00000100:00100000:2.0:1784755956.522704:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784755956.522712:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153339008:12345-0@lo:400: 00000100:00100000:2.0:1784755956.522781:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153339008:12345-0@lo:400: Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755956.522799:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784755956.522919:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153339008:0@lo:400: 00000100:00080000:1.0:1784755956.523991:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784755956.766971:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755957.535106:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153339136:0@lo:13: 00000100:00100000:1.0:1784755957.535188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755957.535568:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339136 00000100:00100000:0.0:1784755957.535578:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339136 00000100:00100000:0.0:1784755957.535668:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784755957.535680:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153339136:12345-0@lo:13: 00002000:00000024:0.0:1784755957.535718:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755957.536041:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153339136:12345-0@lo:13: Request processed in 363us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755957.536049:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784755957.536109:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf60434380 x1871452153339136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755957.536129:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153339136:0@lo:13: 00000100:00100000:3.0:1784755957.787220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755957.788966:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541440 00000100:00100000:1.0:1784755957.788980:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541440 00000100:00100000:1.0:1784755957.789929:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00100000:1.0:1784755957.789943:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:5648:x1871452136541440:12345-192.168.202.8@tcp:41: 00000004:00000024:1.0:1784755957.790002:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784755957.790110:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:5648:x1871452136541440:12345-192.168.202.8@tcp:41: Request processed in 171us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755957.790118:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00080000:3.0:1784755957.793880:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784755957.793952:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755957.796549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755957.797835:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541568 00000100:00100000:1.0:1784755957.797865:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541568 00000100:00100000:1.0:1784755957.798023:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:1.0:1784755957.798036:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5648:x1871452136541568:12345-192.168.202.8@tcp:13: 00002000:00000024:1.0:1784755957.798072:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755957.798175:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5648:x1871452136541568:12345-192.168.202.8@tcp:13: Request processed in 141us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755957.798183:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00080000:3.0:1784755957.798747:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784755957.802531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755957.802596:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541696 00000100:00100000:1.0:1784755957.802679:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541696 00000100:00100000:1.0:1784755957.802740:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00100000:1.0:1784755957.802748:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5648:x1871452136541696:12345-192.168.202.8@tcp:13: 00002000:00000024:1.0:1784755957.802785:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784755957.802885:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784755957.802920:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5648:x1871452136541696:12345-192.168.202.8@tcp:13: Request processed in 164us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755957.802926:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 9 00000001:00100000:2.0:1784755958.591773:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00010000:00010000:0.0:1784755958.820190:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784755959.113453:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000001:00100000:3.0:1784755959.641228:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00010000:00010000:3.0:1784755959.839271:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784755960.220603:0:8149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1784755960.741882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755960.741927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755960.742068:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541824 00000100:00100000:0.0:1784755960.742079:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541824 00000100:00100000:0.0:1784755960.742137:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 127 00000100:00100000:0.0:1784755960.742148:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136541824:12345-192.168.202.8@tcp:400: 00000100:00100000:0.0:1784755960.744110:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136541824:12345-192.168.202.8@tcp:400: Request processed in 1952us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755960.744124:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 127 00000100:00100000:2.0:1784755960.745361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755960.745393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755960.745475:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136541952 00000100:00100000:0.0:1784755960.745483:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136541952 00000100:00100000:0.0:1784755960.745539:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 19 00000100:00100000:0.0:1784755960.745548:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136541952:12345-192.168.202.8@tcp:400: 00000100:00100000:0.0:1784755960.745617:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136541952:12345-192.168.202.8@tcp:400: Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755960.745625:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 19 00000100:00080000:0.0:1784755960.745673:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784755960.746783:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542080 00000100:00100000:3.0:1784755960.746970:0:7966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542208 00000100:00100000:3.0:1784755960.746978:0:7966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542208 00000100:00100000:0.0:1784755960.747349:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542080 00000100:00080000:1.0:1784755960.747410:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784755960.747524:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:0.0:1784755960.747535:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542080:12345-192.168.202.8@tcp:400: 00000100:00100000:0.0:1784755960.747602:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542080:12345-192.168.202.8@tcp:400: Request processed in 68us (5674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755960.747610:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:2.0:1784755960.747668:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00100000:2.0:1784755960.747677:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542208:12345-192.168.202.8@tcp:400: 00000100:00100000:2.0:1784755960.747753:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542208:12345-192.168.202.8@tcp:400: Request processed in 77us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755960.747760:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00080000:1.0:1784755960.749834:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784755960.871290:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755961.631277:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784755961.631304:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153339264:0@lo:13: 00000100:00100000:1.0:1784755961.631371:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755961.631427:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339264 00000100:00100000:1.0:1784755961.631434:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339264 00000100:00100000:1.0:1784755961.631487:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755961.631496:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153339264:12345-0@lo:13: 00002000:00000024:1.0:1784755961.631531:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755961.631589:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153339264:12345-0@lo:13: Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755961.631596:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784755961.631617:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784755961.631667:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bc0ed80 x1871452153339264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755961.631684:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153339264:0@lo:13: 00000100:00100000:2.0:1784755961.638294:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153339392:0@lo:400: 00000100:00100000:2.0:1784755961.638382:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755961.638429:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153339904:0@lo:400: 00000100:00100000:2.0:1784755961.638458:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755961.638485:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784755961.638492:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153339520:0@lo:400: 00000100:00100000:2.0:1784755961.638514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755961.638790:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339392 00000100:00100000:2.0:1784755961.638799:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339392 00000100:00100000:2.0:1784755961.638846:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784755961.638855:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153339392:12345-0@lo:400: 00000100:00100000:2.0:1784755961.638921:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153339392:12345-0@lo:400: Request processed in 67us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755961.638929:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784755961.638970:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339904 00000100:00100000:2.0:1784755961.638974:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339904 00000100:00100000:2.0:1784755961.639009:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339520 00000100:00100000:2.0:1784755961.639012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339520 00000100:00100000:2.0:1784755961.639027:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784755961.639033:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153339904:12345-0@lo:400: 00000100:00100000:2.0:1784755961.639066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153339904:12345-0@lo:400: Request processed in 33us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755961.639073:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784755961.639086:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784755961.639092:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153339520:12345-0@lo:400: 00000100:00100000:2.0:1784755961.639120:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153339520:12345-0@lo:400: Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755961.639125:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1784755961.639145:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755961.639160:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153339776:0@lo:400: 00000100:00100000:2.0:1784755961.639230:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755961.639251:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755961.639258:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153339648:0@lo:400: 00000100:00100000:2.0:1784755961.639281:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755961.639306:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339776 00000100:00100000:2.0:1784755961.639309:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339776 00000100:00100000:2.0:1784755961.639343:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755961.639349:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153339776:12345-0@lo:400: 00000100:00100000:2.0:1784755961.639381:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153339776:12345-0@lo:400: Request processed in 32us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755961.639387:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1784755961.639404:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784755961.639448:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857800 x1871452153339776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755961.639462:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153339776:0@lo:400: 00000100:00100000:2.0:1784755961.639481:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153339648 00000100:00100000:2.0:1784755961.639485:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153339648 00000100:00100000:2.0:1784755961.639512:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784755961.639519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153339648:12345-0@lo:400: 00000100:00100000:2.0:1784755961.639552:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153339648:12345-0@lo:400: Request processed in 34us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755961.639559:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784755961.639574:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755961.639589:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153339648:0@lo:400: 00000100:00100000:2.0:1784755961.639611:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153339520:0@lo:400: 00000100:00100000:2.0:1784755961.639620:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153339392:0@lo:400: 00000100:00100000:2.0:1784755961.639630:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153339904:0@lo:400: 00010000:00010000:3.0:1784755961.886817:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755962.656017:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153340032:0@lo:13: 00000100:00100000:2.0:1784755962.656086:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755962.659165:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340032 00000100:00100000:0.0:1784755962.659181:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340032 00000100:00100000:0.0:1784755962.659272:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784755962.659285:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153340032:12345-0@lo:13: 00002000:00000024:2.0:1784755962.659368:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755962.660079:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153340032:12345-0@lo:13: Request processed in 794us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.660090:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1784755962.660145:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80857480 x1871452153340032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755962.660168:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153340032:0@lo:13: 00010000:00010000:1.0:1784755962.910956:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784755963.308822:0:8297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe97b67800 20000000:00000080:2.0:1784755963.308840:0:8297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fce46ecb800 uarg=0000000000000000 20000000:01000000:2.0:1784755963.308916:0:8297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1784755963.308919:0:8297:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1784755963.308921:0:8297:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784755963.308926:0:8297:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784755963.308932:0:8297:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1784755963.308946:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784755963.308948:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784755963.309155:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784755963.309159:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784755963.312633:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1784755963.314481:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1784755963.314561:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1784755963.314604:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1784755963.314622:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784755963.314626:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784755963.317411:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784755963.318152:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784755963.318208:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784755963.318243:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784755963.318256:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784755963.318259:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784755963.320750:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1784755963.322387:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1784755963.322598:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1784755963.322894:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1784755963.322912:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784755963.322914:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784755963.325911:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784755963.327317:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784755963.327508:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784755963.327554:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1784755963.327571:0:8297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784755963.327589:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327607:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327614:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327621:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327627:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327633:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327839:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327846:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327855:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327882:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327890:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327928:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.327943:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 9 pid: 5791 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.328103:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340160:192.168.202.8@tcp:104: 00010000:00010000:0.0:1784755963.328315:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328324:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 9 pid: 5789 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.328333:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340288:192.168.202.8@tcp:104: 00010000:00010000:0.0:1784755963.328364:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328373:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 18 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.328426:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340416:0@lo:104: 00000100:00100000:0.0:1784755963.328466:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784755963.328522:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328530:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 18 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.328538:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340544:0@lo:104: 00000100:00100000:0.0:1784755963.328561:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755963.328595:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784755963.328608:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340416 00000100:00100000:0.0:1784755963.328614:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340416 00000100:00100000:0.0:1784755963.328672:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340544 00000100:00100000:0.0:1784755963.328675:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340544 00000100:00100000:0.0:1784755963.328689:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755963.328697:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8297:x1871452153340416:12345-0@lo:104: 00010000:00010000:0.0:1784755963.328709:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328753:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755963.328771:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8297:x1871452153340416:12345-0@lo:104: Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.328778:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755963.328793:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784755963.328798:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce46f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340544:12345-0@lo:104: 00010000:00010000:0.0:1784755963.328805:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328839:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784755963.328844:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce46f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340544:12345-0@lo:104: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.328857:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1784755963.328914:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.328923:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 18 pid: 5791 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.328931:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340672:0@lo:104: 00000100:00100000:0.0:1784755963.328951:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755963.328980:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340672 00000100:00100000:0.0:1784755963.328984:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340672 00000100:00100000:0.0:1784755963.329000:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755963.329006:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340672:12345-0@lo:104: 00010000:00010000:0.0:1784755963.329013:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.329053:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784755963.329058:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340672:12345-0@lo:104: Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.329063:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1784755963.329087:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.329094:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 18 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.329102:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80854a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340800:0@lo:104: 00000100:00100000:0.0:1784755963.329122:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755963.329148:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340800 00000100:00100000:0.0:1784755963.329151:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340800 00000100:00100000:0.0:1784755963.329166:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755963.329171:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340800:12345-0@lo:104: 00010000:00010000:0.0:1784755963.329181:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329711:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784755963.329718:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329726:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271600 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:3.0:1784755963.329732:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329740:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755963.329747:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755963.329752:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755963.329792:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329798:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755963.329817:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329831:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf43271600/0x8f2fc1536a2c3586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c358d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329847:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784755963.329851:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329856:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74010200 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:3.0:1784755963.329858:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329875:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755963.329881:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755963.329885:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755963.329900:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329905:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755963.329911:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329917:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3563 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329927:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784755963.329936:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329942:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270200 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:3.0:1784755963.329945:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329951:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755963.329968:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755963.329973:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755963.329988:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.329993:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755963.330020:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.330033:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf43270200/0x8f2fc1536a2c3540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3547 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.330041:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755963.330043:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755963.330045:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755963.330070:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153341184:0@lo:103: 00010000:00010000:1.0:1784755963.330294:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755963.330305:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153340928:0@lo:103: 00000100:00100000:3.0:1784755963.330831:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755963.330902:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341184 00000100:00100000:3.0:1784755963.330909:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341184 00010000:00010000:3.0:1784755963.330951:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 19 pid: 5791 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755963.330993:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755963.331001:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153341184:12345-0@lo:103: 00010000:00010000:3.0:1784755963.331021:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755963.331033:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 19 pid: 5791 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.331044:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 19 pid: 5791 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.331061:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755963.331095:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153341184:12345-0@lo:103: Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755963.331102:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755963.331152:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153341184:0@lo:103: 00000100:00100000:1.0:1784755963.331978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755963.332021:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784755963.332198:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341056:0@lo:103: 00000100:00100000:1.0:1784755963.332230:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755963.332263:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153340928 00000100:00100000:1.0:1784755963.332268:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153340928 00010000:00010000:1.0:1784755963.332291:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 19 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.332310:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341056 00000100:00100000:1.0:1784755963.332312:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341056 00010000:00010000:1.0:1784755963.332324:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 20 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.332335:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784755963.332342:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3314:x1871452153340928:12345-0@lo:103: 00010000:00010000:1.0:1784755963.332351:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755963.332355:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 20 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.332373:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 20 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.332561:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755963.332601:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3314:x1871452153340928:12345-0@lo:103: Request processed in 259us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755963.332609:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784755963.332627:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784755963.332632:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153341056:12345-0@lo:103: 00010000:00010000:1.0:1784755963.332658:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755963.332663:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 19 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.332671:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 19 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.332681:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755963.332703:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153341056:12345-0@lo:103: Request processed in 71us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755963.332708:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784755963.332735:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341056:0@lo:103: 00000100:00100000:1.0:1784755963.332744:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153340928:0@lo:103: 00010000:00010000:1.0:1784755963.333280:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.333292:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 18 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.333319:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341312:0@lo:104: 00000100:00100000:1.0:1784755963.333352:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784755963.333532:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.333541:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 18 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.333550:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341440:0@lo:104: 00000100:00100000:1.0:1784755963.333586:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784755963.333722:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755963.333730:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153340800:12345-0@lo:104: Request processed in 4558us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.333739:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1784755963.334450:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.334460:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 18 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.334469:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341568:0@lo:104: 00000100:00100000:1.0:1784755963.334498:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755963.334665:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341312 00000100:00100000:0.0:1784755963.334673:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341312 00000100:00100000:0.0:1784755963.334701:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341440 00000100:00100000:0.0:1784755963.334704:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341440 00000100:00100000:0.0:1784755963.334718:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755963.334725:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8297:x1871452153341312:12345-0@lo:104: 00010000:00010000:0.0:1784755963.334737:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.334797:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784755963.334803:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8297:x1871452153341312:12345-0@lo:104: Request processed in 79us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.334808:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755963.334822:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755963.334828:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153341440:12345-0@lo:104: 00010000:00010000:0.0:1784755963.334835:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.334888:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784755963.334893:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153341440:12345-0@lo:104: Request processed in 66us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.334900:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1784755963.336204:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784755963.336216:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336226:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271200 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:2.0:1784755963.336230:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336239:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755963.336246:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755963.336251:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755963.336311:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336318:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755963.336348:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336356:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf43271200/0x8f2fc1536a2c3532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3539 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336371:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784755963.336374:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.336380:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271400 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:2.0:1784755963.336383:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337661:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755963.337673:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755963.337678:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755963.337707:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337712:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755963.337734:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337740:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf43271400/0x8f2fc1536a2c3524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c352b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337753:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755963.337777:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337783:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82150e00 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:2.0:1784755963.337786:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337792:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755963.337798:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755963.337802:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755963.337814:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337818:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755963.337824:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337829:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c34fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3501 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.337838:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755963.337840:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755963.337842:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755963.337870:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153341696:0@lo:103: 00000100:00100000:2.0:1784755963.337929:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755963.338247:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341824:0@lo:103: 00000100:00100000:2.0:1784755963.338281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755963.338303:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755963.338308:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341952:0@lo:103: 00000100:00100000:2.0:1784755963.338328:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755963.338360:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341696 00000100:00100000:2.0:1784755963.338367:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341696 00010000:00010000:2.0:1784755963.338528:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 19 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755963.338550:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341824 00000100:00100000:2.0:1784755963.338554:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341824 00010000:00010000:2.0:1784755963.338567:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 20 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755963.338578:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341952 00000100:00100000:2.0:1784755963.338580:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341952 00010000:00010000:2.0:1784755963.338590:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 21 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755963.338603:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755963.338611:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+21:3317:x1871452153341696:12345-0@lo:103: 00010000:00010000:2.0:1784755963.338623:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755963.338629:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 21 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338667:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 21 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338686:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755963.338722:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+21:3317:x1871452153341696:12345-0@lo:103: Request processed in 111us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755963.338735:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755963.338752:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784755963.338827:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3314:x1871452153341824:12345-0@lo:103: 00010000:00010000:2.0:1784755963.338835:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755963.338840:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 20 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338848:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 20 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338857:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755963.338893:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3314:x1871452153341824:12345-0@lo:103: Request processed in 136us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755963.338899:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784755963.338912:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784755963.338918:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153341952:12345-0@lo:103: 00010000:00010000:2.0:1784755963.338930:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755963.338934:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 19 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338942:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 19 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.338952:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755963.338970:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153341952:12345-0@lo:103: Request processed in 53us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755963.338974:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784755963.339260:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153341696:0@lo:103: 00000100:00100000:2.0:1784755963.339298:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341952:0@lo:103: 00000100:00100000:2.0:1784755963.339305:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153341824:0@lo:103: 00010000:00010000:3.0:1784755963.339848:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755963.340111:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153341568 00000100:00100000:2.0:1784755963.340118:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153341568 00000100:00100000:2.0:1784755963.340152:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784755963.340160:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153341568:12345-0@lo:104: 00010000:00010000:2.0:1784755963.340172:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755963.340602:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755963.340609:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8297:x1871452153341568:12345-0@lo:104: Request processed in 450us (6110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755963.340616:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1784755963.340700:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784755963.340707:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.340716:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030600 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:3.0:1784755963.340721:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.340729:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755963.340736:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755963.340753:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755963.340799:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.340805:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755963.340818:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.340824:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf40030600/0x8f2fc1536a2c34d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34d7 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.340839:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755963.340841:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755963.340842:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755963.340936:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755963.340948:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153342080:0@lo:103: 00000100:00100000:2.0:1784755963.340983:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755963.341264:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42fafb40 going to sleep for 11 seconds 00010000:00010000:1.0:1784755963.341288:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43270c00/0x8f2fc1536a2c358d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3586 expref: 18 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341300:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340416:0@lo:104: 00010000:00010000:1.0:1784755963.341311:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c355c expref: 17 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341319:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340544:0@lo:104: 00010000:00010000:1.0:1784755963.341328:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3540 expref: 16 pid: 5791 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341344:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340672:0@lo:104: 00010000:00010000:1.0:1784755963.341356:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c3539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3532 expref: 15 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341365:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80854a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340800:0@lo:104: 00010000:00010000:1.0:1784755963.341375:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030c00/0x8f2fc1536a2c352b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3524 expref: 14 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341383:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341312:0@lo:104: 00010000:00010000:1.0:1784755963.341517:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43271a00/0x8f2fc1536a2c3501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c34fa expref: 13 pid: 5790 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.341526:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bc0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341440:0@lo:104: 00000100:00100000:1.0:1784755963.341536:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153341568:0@lo:104: 00000100:00100000:3.0:1784755963.341589:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342080 00000100:00100000:3.0:1784755963.341594:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342080 00010000:00010000:3.0:1784755963.341619:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 13 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755963.341675:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784755963.341684:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf449dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:3317:x1871452153342080:12345-0@lo:103: 00010000:00010000:3.0:1784755963.341695:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755963.341700:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 13 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.341708:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 13 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.341720:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43270800/0x8f2fc1536a2c34d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c34d0 expref: 13 pid: 5789 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.341739:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755963.341794:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf449dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:3317:x1871452153342080:12345-0@lo:103: Request processed in 111us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755963.341801:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784755963.341962:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153342080:0@lo:103: 00000100:00100000:0.0:1784755963.342372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755963.342545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755963.342569:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542464 00000100:00100000:0.0:1784755963.342573:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542464 00010000:00010000:0.0:1784755963.342593:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 10 pid: 5789 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.342611:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542336 00000100:00100000:0.0:1784755963.342614:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542336 00010000:00010000:0.0:1784755963.342623:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 11 pid: 5791 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755963.342633:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 19 00000100:00100000:0.0:1784755963.342659:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+11:2357:x1871452136542464:12345-192.168.202.8@tcp:103: 00010000:00010000:0.0:1784755963.342669:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755963.342674:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 11 pid: 5789 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342682:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 11 pid: 5789 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342695:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755963.342731:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+11:2357:x1871452136542464:12345-192.168.202.8@tcp:103: Request processed in 73us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.342748:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 19 00000100:00100000:0.0:1784755963.342773:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 20 00000100:00100000:0.0:1784755963.342779:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136542336:12345-192.168.202.8@tcp:103: 00010000:00010000:0.0:1784755963.342787:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755963.342792:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 10 pid: 5791 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342800:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 10 pid: 5791 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342813:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342821:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342835:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342842:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342849:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342855:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342891:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b8c0400 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784755963.342895:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342910:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342920:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755963.342929:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755963.342949:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136542336:12345-192.168.202.8@tcp:103: Request processed in 170us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755963.342956:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 20 00010000:00010000:1.0:1784755963.343541:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030a00/0x8f2fc1536a2c35a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b8f expref: 9 pid: 5791 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.343556:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340160:192.168.202.8@tcp:104: 00010000:00010000:1.0:1784755963.343568:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011400/0x8f2fc1536a2c359b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2b88 expref: 8 pid: 5789 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755963.343576:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452153340288:192.168.202.8@tcp:104: 00010000:00010000:1.0:1784755963.343614:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.343633:0:8297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.343662:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755963.343668:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf7b8c0400/0x8f2fc1536a2c35da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755963.934883:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755964.958893:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784755965.150952:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784755965.150960:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fce44a76800 from 39 10000000:01000000:3.0:1784755965.150966:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784755965.151016:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.151028:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.151039:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755965.151063:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342208:0@lo:101: 00000100:00100000:3.0:1784755965.151133:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.151198:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.151345:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342208 00000100:00100000:2.0:1784755965.151352:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342208 00000100:00100000:2.0:1784755965.151405:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784755965.151414:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+12:5793:x1871452153342208:12345-0@lo:101: 00010000:00010000:2.0:1784755965.151427:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755965.151439:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c35e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c35e1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.151477:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c35e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35e1 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.151506:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271400/0x8f2fc1536a2c35e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35e1 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.151515:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271400, rc 0) 00000100:00100000:2.0:1784755965.151613:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342208:12345-0@lo:101: Request processed in 200us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.151620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784755965.153940:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342208:0@lo:101: 00010000:00010000:1.0:1784755965.154169:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35e8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.154183:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c35e8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755965.154266:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342336:0@lo:501: 00000100:00100000:1.0:1784755965.154328:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.154432:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.154531:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342336 00000100:00100000:2.0:1784755965.154538:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342336 00000100:00100000:2.0:1784755965.155341:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784755965.155355:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342336:12345-0@lo:501: 00000100:00100000:2.0:1784755965.155663:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342336:12345-0@lo:501: Request processed in 312us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.155671:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784755965.155765:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342336:0@lo:501: 00000100:00100000:1.0:1784755965.155804:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342464:0@lo:503: 00000100:00100000:1.0:1784755965.155835:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.157522:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.157766:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342464 00000100:00100000:0.0:1784755965.157775:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342464 00000100:00100000:0.0:1784755965.157825:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784755965.157835:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342464:12345-0@lo:503: 00000100:00100000:0.0:1784755965.159550:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342464:12345-0@lo:503: Request processed in 1710us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.159561:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784755965.159905:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342464:0@lo:503: 00000100:00100000:3.0:1784755965.160567:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8315:1871452153342592:0@lo:502: 00000100:00100000:3.0:1784755965.160625:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.160686:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b300 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.160737:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342592 00000100:00100000:2.0:1784755965.160744:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342592 00000100:00100000:2.0:1784755965.160786:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784755965.160796:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:8315:x1871452153342592:12345-0@lo:502: 00000100:00100000:2.0:1784755965.161055:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:8315:x1871452153342592:12345-0@lo:502: Request processed in 260us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.161063:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784755965.161266:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8315:1871452153342592:0@lo:502: 00000100:00100000:3.0:1784755965.161307:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8315:1871452153342720:0@lo:502: 00000100:00100000:3.0:1784755965.161341:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.161372:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.161485:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342720 00000100:00100000:0.0:1784755965.161489:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342720 00000100:00100000:0.0:1784755965.161524:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784755965.161531:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:8315:x1871452153342720:12345-0@lo:502: 00000100:00100000:0.0:1784755965.161696:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:8315:x1871452153342720:12345-0@lo:502: Request processed in 165us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.161702:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784755965.161864:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8315:1871452153342720:0@lo:502: 00000040:00080000:1.0:1784755965.161893:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784755965.162037:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784755965.162056:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784755965.162068:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35e8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.162080:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74010200/0x8f2fc1536a2c35e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35e8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755965.162089:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784755965.162092:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784755965.162094:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784755965.162123:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.162130:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.162139:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755965.162151:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342848:0@lo:101: 00000100:00100000:3.0:1784755965.162180:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.162213:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.162305:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342848 00000100:00100000:0.0:1784755965.162309:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342848 00000100:00100000:0.0:1784755965.162341:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784755965.162354:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+13:5793:x1871452153342848:12345-0@lo:101: 00010000:00010000:0.0:1784755965.162364:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755965.162384:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c1600/0x8f2fc1536a2c35f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c35ef expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.162406:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c1600/0x8f2fc1536a2c35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35ef expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.162416:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b8c1600/0x8f2fc1536a2c35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35ef expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.162424:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c1600, rc 0) 00000100:00100000:0.0:1784755965.162463:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153342848:12345-0@lo:101: Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.162469:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784755965.162596:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342848:0@lo:101: 00010000:00010000:2.0:1784755965.162608:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35f6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.162617:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c35f6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755965.162691:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342976:0@lo:501: 00000100:00100000:2.0:1784755965.162717:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755965.162743:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf667d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.162793:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153342976 00000100:00100000:3.0:1784755965.162797:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153342976 00000100:00100000:3.0:1784755965.162828:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784755965.162835:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153342976:12345-0@lo:501: 00000100:00100000:3.0:1784755965.163243:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153342976:12345-0@lo:501: Request processed in 408us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.163258:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784755965.163327:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153342976:0@lo:501: 00000100:00100000:2.0:1784755965.163353:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343104:0@lo:503: 00000100:00100000:2.0:1784755965.163400:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755965.163420:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf667d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.163623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343104 00000100:00100000:3.0:1784755965.163628:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343104 00000100:00100000:3.0:1784755965.163681:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784755965.163688:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153343104:12345-0@lo:503: 00000100:00100000:3.0:1784755965.163829:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153343104:12345-0@lo:503: Request processed in 141us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.163836:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784755965.164554:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343104:0@lo:503: 00000100:00100000:1.0:1784755965.164937:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8316:1871452153343232:0@lo:502: 00000100:00100000:1.0:1784755965.164994:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.165031:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744900 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.165155:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343232 00000100:00100000:3.0:1784755965.165161:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343232 00000100:00100000:3.0:1784755965.165196:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784755965.165203:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:8316:x1871452153343232:12345-0@lo:502: 00000100:00100000:3.0:1784755965.165360:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:8316:x1871452153343232:12345-0@lo:502: Request processed in 158us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.165367:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784755965.165505:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8316:1871452153343232:0@lo:502: 00000020:01000000:1.0:1784755965.165527:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755965.165536:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755965.165539:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784755965.165545:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784755965.165565:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8316:1871452153343360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.165596:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.165616:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744900 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.165664:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343360 00000100:00100000:0.0:1784755965.165669:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343360 00000100:00100000:0.0:1784755965.165694:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784755965.165700:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:8316:x1871452153343360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.165813:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:8316:x1871452153343360:12345-0@lo:502:llog_process_th.0 Request processed in 112us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.165820:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784755965.166057:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8316:1871452153343360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755965.166074:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755965.166079:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755965.166080:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784755965.166084:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784755965.166252:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1784755965.166272:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784755965.166281:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35f6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.166292:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74011200/0x8f2fc1536a2c35ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c35f6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755965.166301:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784755965.166303:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf463c1000 from 39 10000000:01000000:3.0:1784755965.166305:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784755965.166326:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.166344:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.166353:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755965.166366:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.166463:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.166491:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.166540:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343488 00000100:00100000:0.0:1784755965.166544:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343488 00000100:00100000:0.0:1784755965.166573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784755965.166580:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+14:5793:x1871452153343488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755965.166589:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755965.166600:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c0000/0x8f2fc1536a2c3604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c35fd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.166627:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c0000/0x8f2fc1536a2c3604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35fd expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.166665:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b8c0000/0x8f2fc1536a2c3604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c35fd expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.166674:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c0000, rc 0) 00000100:00100000:0.0:1784755965.166709:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153343488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.166715:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784755965.168103:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755965.168122:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3604 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.168133:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3604 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755965.168198:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.168253:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.168279:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744900 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.168384:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343616 00000100:00100000:0.0:1784755965.168390:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343616 00000100:00100000:0.0:1784755965.168433:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784755965.168442:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153343616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.168719:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153343616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.168726:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784755965.169002:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.169042:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.169081:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.169110:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.169258:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343744 00000100:00100000:0.0:1784755965.169263:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343744 00000100:00100000:0.0:1784755965.169295:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784755965.169303:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153343744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.169453:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153343744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.169460:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784755965.169499:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153343744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.169700:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8317:1871452153343872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.169734:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.169752:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153343872 00000100:00100000:0.0:1784755965.169755:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153343872 00000100:00100000:0.0:1784755965.169772:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784755965.169779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:8317:x1871452153343872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.169937:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:8317:x1871452153343872:12345-0@lo:502:llog_process_th.0 Request processed in 158us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.169944:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784755965.169981:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf46687e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.169993:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8317:1871452153343872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.170191:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8317:1871452153344000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.170316:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.170335:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344000 00000100:00100000:0.0:1784755965.170339:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344000 00000100:00100000:0.0:1784755965.170355:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784755965.170360:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:8317:x1871452153344000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.170493:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42fafc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.170810:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:8317:x1871452153344000:12345-0@lo:502:llog_process_th.0 Request processed in 449us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.170817:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784755965.171143:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8317:1871452153344000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784755965.171167:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784755965.172099:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784755965.172123:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755965.172132:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3604 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.172159:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74011000/0x8f2fc1536a2c35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3604 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755965.172169:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784755965.172172:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1784755965.172175:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784755965.172204:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.172212:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.172222:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755965.172243:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.172285:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.172317:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755965.173184:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344128 00000100:00100000:1.0:1784755965.173195:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344128 00000100:00100000:1.0:1784755965.173249:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784755965.173258:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+15:5793:x1871452153344128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755965.173271:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755965.173284:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c360b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.173308:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c360b expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.173319:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82151e00/0x8f2fc1536a2c3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c360b expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.173327:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82151e00, rc 0) 00000100:00100000:1.0:1784755965.173367:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.173373:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784755965.174171:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755965.174191:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3612 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.174201:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3612 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755965.174264:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.174301:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.174352:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.174474:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344256 00000100:00100000:2.0:1784755965.174479:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344256 00000100:00100000:2.0:1784755965.174515:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784755965.174522:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755965.174805:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.174812:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784755965.175490:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.175527:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.175572:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.175605:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.175679:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344384 00000100:00100000:3.0:1784755965.175684:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344384 00000100:00100000:3.0:1784755965.175718:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784755965.175727:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.175901:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.175908:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784755965.176131:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.176608:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8318:1871452153344512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.181590:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.182182:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.182265:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344512 00000100:00100000:0.0:1784755965.182275:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344512 00000100:00100000:0.0:1784755965.182339:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784755965.182348:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:8318:x1871452153344512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.182768:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:8318:x1871452153344512:12345-0@lo:502:llog_process_th.0 Request processed in 419us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.182775:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784755965.183017:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8318:1871452153344512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755965.183060:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755965.183069:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755965.183072:0:8318:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784755965.183077:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784755965.183111:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8318:1871452153344640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.183152:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.183172:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42fafc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.184589:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344640 00000100:00100000:0.0:1784755965.184600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344640 00000100:00100000:0.0:1784755965.184694:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784755965.184703:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:8318:x1871452153344640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.184935:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:8318:x1871452153344640:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.184943:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784755965.185153:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8318:1871452153344640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784755965.185187:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755965.185194:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755965.185196:0:8318:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784755965.185200:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1784755965.185369:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784755965.185400:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784755965.185410:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3612 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.185422:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1a00/0x8f2fc1536a2c360b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3612 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755965.185432:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784755965.185435:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8fcf4549c800 from 39 10000000:01000000:1.0:1784755965.185438:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755965.185465:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.185473:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.185482:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755965.185499:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.185538:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.185584:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.185699:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344768 00000100:00100000:2.0:1784755965.185705:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344768 00000100:00100000:2.0:1784755965.185736:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784755965.185743:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153344768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784755965.185752:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755965.185770:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3619 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.185794:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3619 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.185805:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271200/0x8f2fc1536a2c3620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3619 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.185813:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271200, rc 0) 00000100:00100000:2.0:1784755965.185854:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153344768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.185861:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784755965.186016:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755965.186029:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3620 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.186038:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3620 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755965.186080:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.186102:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.186124:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755965.186137:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153344896 00000100:00100000:1.0:1784755965.186140:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153344896 00000100:00100000:1.0:1784755965.186160:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784755965.186166:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153344896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.186590:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153344896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.186597:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784755965.186630:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153344896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.186687:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.186725:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.186746:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.186796:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345024 00000100:00100000:2.0:1784755965.186801:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345024 00000100:00100000:2.0:1784755965.186830:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784755965.186838:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153345024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755965.187002:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153345024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.187019:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784755965.187157:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.187862:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8319:1871452153345152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.187907:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.188086:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.188216:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345152 00000100:00100000:2.0:1784755965.188222:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345152 00000100:00100000:2.0:1784755965.188283:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784755965.188292:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8319:x1871452153345152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755965.188497:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8319:x1871452153345152:12345-0@lo:502:llog_process_th.0 Request processed in 206us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.188504:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784755965.188574:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8319:1871452153345152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.188613:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8319:1871452153345280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.188670:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.191049:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784755965.191294:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345280 00000100:00100000:1.0:1784755965.191303:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345280 00000100:00100000:1.0:1784755965.191352:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784755965.191500:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8319:x1871452153345280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.195186:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8319:x1871452153345280:12345-0@lo:502:llog_process_th.0 Request processed in 3802us (6503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.195201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784755965.195384:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8319:1871452153345280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784755965.195424:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784755965.195673:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784755965.195694:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784755965.195705:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3620 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.195717:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82150800/0x8f2fc1536a2c3619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3620 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755965.195727:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784755965.195730:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784755965.195733:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784755965.195767:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.195775:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755965.195785:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755965.195807:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.195859:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755965.195886:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.197086:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345408 00000100:00100000:2.0:1784755965.197108:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345408 00000100:00100000:3.0:1784755965.197659:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784755965.197670:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153345408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784755965.197686:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755965.197700:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74011600/0x8f2fc1536a2c362e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3627 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.197739:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011600/0x8f2fc1536a2c362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3627 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.197750:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74011600/0x8f2fc1536a2c362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3627 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.197760:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74011600, rc 0) 00000100:00100000:3.0:1784755965.197825:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153345408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.197832:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784755965.198140:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784755965.198156:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c362e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755965.198166:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c362e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755965.198226:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755965.198257:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755965.198594:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf667d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.198826:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345536 00000100:00100000:0.0:1784755965.198832:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345536 00000100:00100000:0.0:1784755965.198868:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784755965.198875:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153345536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.199320:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153345536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.199327:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784755965.199409:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755965.199442:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755965.199482:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755965.203338:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf667d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.203995:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345664 00000100:00100000:0.0:1784755965.204005:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345664 00000100:00100000:0.0:1784755965.204250:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784755965.204259:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153345664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.204614:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153345664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 354us (5129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.204623:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784755965.204842:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153345664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755965.208082:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8320:1871452153345792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.208167:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.208240:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784755965.208329:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345792 00000100:00100000:1.0:1784755965.208337:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345792 00000100:00100000:1.0:1784755965.208478:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784755965.208488:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8320:x1871452153345792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755965.208774:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8320:x1871452153345792:12345-0@lo:502:llog_process_th.0 Request processed in 287us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.208782:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784755965.208880:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8320:1871452153345792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755965.208910:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755965.208919:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755965.208921:0:8320:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784755965.208932:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784755965.208955:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8320:1871452153345920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755965.208999:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.209273:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e10b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.209351:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153345920 00000100:00100000:3.0:1784755965.209356:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153345920 00000100:00100000:3.0:1784755965.209390:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784755965.209397:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8320:x1871452153345920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755965.209560:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8320:x1871452153345920:12345-0@lo:502:llog_process_th.0 Request processed in 163us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.209568:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784755965.210213:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8320:1871452153345920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755965.210240:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755965.210246:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755965.210248:0:8320:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784755965.210251:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784755965.210497:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784755965.210525:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784755965.210535:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c362e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.210546:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82150e00/0x8f2fc1536a2c3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c362e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755965.210556:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784755965.210559:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8fcf46313380 from 1 10000000:01000000:3.0:1784755965.210569:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784755965.210597:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.210605:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.210614:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755965.210633:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153346048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.210770:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.210805:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755965.210859:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346048 00000100:00100000:0.0:1784755965.210864:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346048 00000100:00100000:0.0:1784755965.210900:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784755965.210908:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153346048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755965.210919:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755965.210931:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c1800/0x8f2fc1536a2c363c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3635 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.210952:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c1800/0x8f2fc1536a2c363c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3635 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.211158:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b8c1800/0x8f2fc1536a2c363c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3635 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755965.211167:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c1800, rc 0) 00000100:00100000:0.0:1784755965.211207:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153346048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 300us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.211213:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784755965.211279:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153346048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784755965.211291:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c363c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.211300:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c363c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755965.211341:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153346176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755965.211364:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755965.211467:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755965.211533:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346176 00000100:00100000:2.0:1784755965.211538:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346176 00000100:00100000:1.0:1784755965.211618:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784755965.211628:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153346176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755965.211908:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153346176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (542us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755965.211915:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784755965.212106:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153346176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784755965.212129:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784755965.212135:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c363c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755965.212155:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf74011400/0x8f2fc1536a2c3635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c363c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755965.851261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755965.851357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755965.851397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755965.851492:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542592 00000100:00100000:1.0:1784755965.851502:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542592 00000100:00100000:1.0:1784755965.851560:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 161 00000100:00100000:1.0:1784755965.851570:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:2356:x1871452136542592:12345-192.168.202.8@tcp:400: 00000100:00100000:1.0:1784755965.851667:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:2356:x1871452136542592:12345-192.168.202.8@tcp:400: Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.851674:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 161 00000100:00100000:3.0:1784755965.852132:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542848 00000100:00100000:3.0:1784755965.852137:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542848 00000100:00100000:3.0:1784755965.852193:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:3.0:1784755965.852200:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542848:12345-192.168.202.8@tcp:400: 00000100:00100000:3.0:1784755965.852241:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2356:x1871452136542848:12345-192.168.202.8@tcp:400: Request processed in 40us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755965.852247:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00080000:1.0:1784755965.852655:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784755965.854037:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542720 00000100:00100000:0.0:1784755965.854047:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542720 00000100:00100000:0.0:1784755965.854193:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00100000:0.0:1784755965.854203:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136542720:12345-192.168.202.8@tcp:400: 00000100:00100000:0.0:1784755965.854278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136542720:12345-192.168.202.8@tcp:400: Request processed in 76us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755965.854285:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00080000:1.0:1784755965.854454:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784755965.874177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755965.874663:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136542976 00000100:00100000:2.0:1784755965.874674:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136542976 00000100:00100000:2.0:1784755965.874755:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 9 00000100:00100000:2.0:1784755965.874767:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136542976:12345-192.168.202.8@tcp:400: 00000100:00080000:1.0:1784755965.874914:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784755965.874997:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136542976:12345-192.168.202.8@tcp:400: Request processed in 232us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.875020:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 9 00010000:00010000:3.0:1784755965.982875:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755966.108341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755966.108493:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543104 00000100:00100000:2.0:1784755966.108502:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543104 00000100:00100000:2.0:1784755966.108598:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 162 00000100:00100000:2.0:1784755966.108608:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+8:5569:x1871452136543104:12345-192.168.202.8@tcp:101: 00010000:00010000:2.0:1784755966.108622:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755966.108665:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf43271c00/0x8f2fc1536a2c3643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bf1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755966.108692:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf43271c00/0x8f2fc1536a2c3643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bf1 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755966.108703:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf43271c00/0x8f2fc1536a2c3643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bf1 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755966.108713:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271c00, rc 0) 00000100:00100000:2.0:1784755966.108768:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543104:12345-192.168.202.8@tcp:101: Request processed in 162us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755966.108775:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 162 00000100:00100000:3.0:1784755966.111789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755966.112517:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543232 00000100:00100000:1.0:1784755966.112527:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543232 00000100:00100000:1.0:1784755966.112602:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 163 00000100:00100000:1.0:1784755966.112612:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543232:12345-192.168.202.8@tcp:501: 00000100:00100000:1.0:1784755966.112960:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543232:12345-192.168.202.8@tcp:501: Request processed in 348us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755966.112977:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 163 00000100:00100000:0.0:1784755966.115456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755966.115716:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543360 00000100:00100000:1.0:1784755966.115726:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543360 00000100:00100000:1.0:1784755966.115778:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 164 00000100:00100000:1.0:1784755966.115787:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543360:12345-192.168.202.8@tcp:503: 00000100:00100000:1.0:1784755966.116034:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543360:12345-192.168.202.8@tcp:503: Request processed in 247us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755966.116042:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 164 00000100:00100000:3.0:1784755966.119263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755966.119537:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543488 00000100:00100000:0.0:1784755966.119547:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543488 00000100:00100000:0.0:1784755966.119612:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 165 00000100:00100000:0.0:1784755966.119621:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:6048:x1871452136543488:12345-192.168.202.8@tcp:502: 00000100:00100000:0.0:1784755966.119972:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:6048:x1871452136543488:12345-192.168.202.8@tcp:502: Request processed in 350us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755966.119980:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 165 00000100:00100000:3.0:1784755966.132300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755966.132461:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543616 00000100:00100000:2.0:1784755966.132473:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543616 00000100:00100000:2.0:1784755966.132536:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 166 00000100:00100000:2.0:1784755966.132546:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:6048:x1871452136543616:12345-192.168.202.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784755966.132868:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:6048:x1871452136543616:12345-192.168.202.8@tcp:502:llog_process_th.0 Request processed in 323us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755966.132877:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 166 00000100:00100000:2.0:1784755966.139423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755966.140698:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543744 00000100:00100000:1.0:1784755966.140711:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543744 00000100:00100000:1.0:1784755966.140772:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 167 00000100:00100000:1.0:1784755966.140781:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136543744:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755966.140798:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755966.140815:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c364a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bf8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755966.140855:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bf8 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755966.140866:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82151800/0x8f2fc1536a2c364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bf8 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755966.140876:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82151800, rc 0) 00000100:00100000:1.0:1784755966.141536:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136543744:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 Request processed in 752us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755966.141545:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 167 00000100:00100000:3.0:1784755966.151496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755966.151585:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136543872 00000100:00100000:0.0:1784755966.151596:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136543872 00000100:00100000:0.0:1784755966.151720:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 168 00000100:00100000:0.0:1784755966.151731:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136543872:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755966.152093:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136543872:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 Request processed in 363us (607us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784755966.152102:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 168 00000100:00100000:0.0:1784755966.751422:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784755966.751448:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153346688:0@lo:400:kworker.0 00000100:00100000:1.0:1784755966.751463:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153346432:0@lo:400:kworker.0 00000100:00100000:3.0:1784755966.751527:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153346816:0@lo:400:kworker.0 00000100:00100000:2.0:1784755966.751755:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153346560:0@lo:400:kworker.0 00000100:00100000:0.0:1784755966.758303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755966.758374:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153346304:0@lo:400:kworker.0 00000100:00100000:0.0:1784755966.758414:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755966.758523:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346688 00000100:00100000:0.0:1784755966.758531:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346688 00000100:00100000:0.0:1784755966.758610:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784755966.758620:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153346688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755966.758691:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153346688:12345-0@lo:400:kworker.0 Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755966.758698:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784755966.758740:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab5180 x1871452153346688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755966.758752:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153346688:0@lo:400:kworker.0 00000100:00080000:0.0:1784755966.758777:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784755966.758794:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346304 00000100:00100000:0.0:1784755966.758798:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346304 00000100:00100000:0.0:1784755966.758826:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784755966.758865:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755966.758911:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153346304:12345-0@lo:400:kworker.0 Request processed in 48us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755966.758917:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784755966.758947:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153346304:0@lo:400:kworker.0 00000100:00100000:3.0:1784755966.764101:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755966.764723:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346816 00000100:00100000:0.0:1784755966.764735:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346816 00000100:00100000:0.0:1784755966.764814:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784755966.764826:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153346816:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784755966.765121:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784755966.765246:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153346816:12345-0@lo:400:kworker.0 Request processed in 422us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755966.765254:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755966.765493:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153346816:0@lo:400:kworker.0 00000100:00100000:1.0:1784755966.765769:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755966.765795:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153346944:0@lo:400:kworker.0 00000100:00100000:1.0:1784755966.765823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755966.765987:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346944 00000100:00100000:3.0:1784755966.765992:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346944 00000100:00100000:3.0:1784755966.766166:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755966.766174:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153346944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755966.766219:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153346944:12345-0@lo:400:kworker.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755966.766234:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784755966.766263:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784755966.766325:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784755966.766349:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab7800 x1871452153346944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755966.766361:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153346944:0@lo:400:kworker.0 00000100:00100000:2.0:1784755966.766363:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153347072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784755966.766388:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755966.766411:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347072 00000100:00100000:2.0:1784755966.766414:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347072 00000100:00100000:2.0:1784755966.766441:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755966.766447:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153347072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784755966.766473:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755966.766504:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153347072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755966.766510:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784755966.766534:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7b8fea00 x1871452153347072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755966.766548:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153347072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784755966.766626:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346432 00000100:00100000:0.0:1784755966.766631:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346432 00000100:00100000:0.0:1784755966.766678:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153346560 00000100:00100000:0.0:1784755966.766681:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153346560 00000100:00100000:3.0:1784755966.766706:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1784755966.766736:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755966.766762:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153346432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755966.766809:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153346432:12345-0@lo:400:kworker.0 Request processed in 95us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755966.766869:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153346432:0@lo:400:kworker.0 00000100:00100000:2.0:1784755966.767167:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784755966.767176:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784755966.773677:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755966.773703:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755966.773798:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153346560:12345-0@lo:400:kworker.0 Request processed in 108us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755966.773806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755966.773882:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153346560:0@lo:400:kworker.0 00000100:00100000:3.0:1784755966.776587:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1784755967.006823:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784755967.682833:0:8358:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff582bda10 20000000:00000080:3.0:1784755967.682851:0:8358:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fce4684b800 uarg=0000000000000000 20000000:01000000:3.0:1784755967.682893:0:8358:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784755967.682900:0:8358:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784755967.682905:0:8358:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784755967.688414:0:8359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784755967.688876:0:8358:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1784755967.691270:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1784755967.691314:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1784755967.691355:0:8358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1784755967.691369:0:8358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784755967.691387:0:8358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691404:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691412:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691419:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691439:0:8358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691447:0:8358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691484:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.691499:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 9 pid: 5791 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.691513:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347200:192.168.202.8@tcp:104: 00010000:00010000:3.0:1784755967.692859:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.692873:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 18 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.692885:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347328:0@lo:104: 00000100:00100000:3.0:1784755967.692945:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755967.692981:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.692988:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.692995:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347456:0@lo:104: 00000100:00100000:3.0:1784755967.693033:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755967.697530:0:8358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.697549:0:8358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 18 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.697564:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347584:0@lo:104: 00000100:00100000:3.0:1784755967.697612:0:8358:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf5592b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755967.699300:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784755967.699341:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755967.699362:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347328 00000100:00100000:1.0:1784755967.699497:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347328 00000100:00100000:1.0:1784755967.699540:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347456 00000100:00100000:1.0:1784755967.699543:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347456 00000100:00100000:1.0:1784755967.699554:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347584 00000100:00100000:1.0:1784755967.699556:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347584 00000100:00100000:1.0:1784755967.699568:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755967.699577:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:8358:x1871452153347328:12345-0@lo:104: 00010000:00010000:1.0:1784755967.699593:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.699795:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347328:0@lo:104: 00010000:00010000:1.0:1784755967.700007:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755967.700014:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+5:8358:x1871452153347328:12345-0@lo:104: Request processed in 438us (7069us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755967.700047:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755967.700070:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784755967.700076:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8358:x1871452153347456:12345-0@lo:104: 00010000:00010000:1.0:1784755967.700085:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.705848:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347456:0@lo:104: 00000100:00100000:3.0:1784755967.706022:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347200:192.168.202.8@tcp:104: 00010000:00010000:0.0:1784755967.707492:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784755967.707504:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707517:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271000 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755967.707521:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707532:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755967.707538:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755967.707544:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784755967.707595:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707602:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755967.707627:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707662:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf43271000/0x8f2fc1536a2c34ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c34f3 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707677:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755967.707681:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707686:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74010400 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755967.707689:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707696:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755967.707702:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755967.707706:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784755967.707722:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707728:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755967.707735:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707740:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf74010400/0x8f2fc1536a2c3421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3428 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.707749:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755967.707756:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755967.707758:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755967.707785:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153347712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784755967.707855:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755967.707903:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784755967.707909:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153347840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784755967.707930:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755967.707961:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347712 00000100:00100000:0.0:1784755967.707969:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347712 00010000:00010000:0.0:1784755967.707998:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 19 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755967.708021:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347840 00000100:00100000:0.0:1784755967.708024:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347840 00010000:00010000:0.0:1784755967.708035:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 20 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755967.708480:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784755967.708490:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3316:x1871452153347712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784755967.708505:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755967.708510:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 20 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708520:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 20 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708533:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf43271800/0x8f2fc1536a2c34f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c34ec expref: 20 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708547:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755967.708600:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153347712:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755967.708608:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784755967.708625:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755967.708632:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:3316:x1871452153347840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784755967.708662:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755967.708667:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708675:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708683:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030200/0x8f2fc1536a2c3428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c3421 expref: 18 pid: 5789 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.708691:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755967.708712:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3316:x1871452153347840:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755967.708717:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755967.708760:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153347840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784755967.708768:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153347712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784755967.710281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1784755967.710396:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1784755967.710408:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:8358:x1871452153347456:12345-0@lo:104: Request processed in 10330us (17371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755967.710420:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784755967.710489:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784755967.710501:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8358:x1871452153347584:12345-0@lo:104: 00010000:00010000:1.0:1784755967.710516:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755967.710577:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755967.710583:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:8358:x1871452153347584:12345-0@lo:104: Request processed in 86us (11245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755967.710588:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1784755967.710847:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755967.710854:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.710861:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40031200 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784755967.710866:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.710883:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755967.710890:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755967.710895:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784755967.710931:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.710936:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755967.710957:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.710964:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf40031200/0x8f2fc1536a2c33bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c33c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.710986:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755967.710988:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755967.710989:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755967.710996:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755967.711010:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153347968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784755967.711163:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755967.711241:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755967.711411:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544000 00000100:00100000:3.0:1784755967.711419:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544000 00010000:00010000:3.0:1784755967.711448:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.711486:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153347968 00000100:00100000:3.0:1784755967.711489:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153347968 00010000:00010000:3.0:1784755967.711503:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 17 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.711517:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00100000:3.0:1784755967.711524:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136544000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784755967.711536:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755967.711540:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711552:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711574:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40030e00/0x8f2fc1536a2c35b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bc0 expref: 10 pid: 5791 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711587:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755967.711659:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:2356:x1871452136544000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 135us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755967.711666:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00100000:3.0:1784755967.711681:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755967.711688:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3315:x1871452153347968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784755967.711696:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755967.711701:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 17 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711710:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 17 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711722:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711730:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711743:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711750:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711756:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711768:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711774:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74011a00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:3.0:1784755967.711778:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711785:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711795:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711804:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755967.711852:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3315:x1871452153347968:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755967.711858:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1784755967.711906:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf40031600/0x8f2fc1536a2c33c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c33bf expref: 16 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755967.711916:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8358:1871452153347584:0@lo:104: 00010000:00010000:3.0:1784755967.711939:0:8358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711947:0:8358:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711953:0:8358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755967.711972:0:8358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf74011a00/0x8f2fc1536a2c3651 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755967.712291:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153347968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784755967.775785:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755967.775809:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153348096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784755967.775894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755967.775959:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348096 00000100:00100000:2.0:1784755967.775966:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348096 00000100:00100000:2.0:1784755967.776009:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755967.776017:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153348096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784755967.776050:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755967.776107:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153348096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755967.776114:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784755967.776172:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7b8fea00 x1871452153348096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755967.776190:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153348096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784755967.974168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755967.974439:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544128 00000100:00100000:0.0:1784755967.974450:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544128 00000100:00100000:0.0:1784755967.974507:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 170 00000100:00100000:0.0:1784755967.974518:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136544128:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755967.974549:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755967.974571:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2bff expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.974602:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.974614:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755967.974623:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c1c00, rc 0) 00000100:00100000:0.0:1784755967.974705:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136544128:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 Request processed in 189us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755967.974713:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 170 00000100:00100000:2.0:1784755967.978066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755967.978167:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544256 00000100:00100000:0.0:1784755967.978177:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544256 00000100:00100000:0.0:1784755967.978235:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 171 00000100:00100000:0.0:1784755967.978246:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136544256:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755967.978587:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136544256:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 Request processed in 341us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755967.978596:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 171 00000100:00100000:3.0:1784755967.990482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755967.990581:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544384 00000100:00100000:1.0:1784755967.990591:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544384 00000100:00100000:1.0:1784755967.990687:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 172 00000100:00100000:1.0:1784755967.990698:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136544384:12345-192.168.202.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755967.990936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136544384:12345-192.168.202.8@tcp:503:ll_cfg_requeue.0 Request processed in 239us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755967.990954:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 172 00000100:00100000:3.0:1784755967.999704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755967.999808:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544512 00000100:00100000:2.0:1784755967.999827:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544512 00000100:00100000:2.0:1784755967.999897:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 173 00000100:00100000:2.0:1784755967.999908:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:6089:x1871452136544512:12345-192.168.202.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784755968.000180:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:6089:x1871452136544512:12345-192.168.202.8@tcp:502:llog_process_th.0 Request processed in 273us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755968.000189:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 173 00000100:00100000:2.0:1784755968.012210:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755968.012310:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544640 00000100:00100000:0.0:1784755968.012321:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544640 00000100:00100000:0.0:1784755968.012390:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 174 00000100:00100000:0.0:1784755968.012410:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:6089:x1871452136544640:12345-192.168.202.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784755968.012709:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf45497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:6089:x1871452136544640:12345-192.168.202.8@tcp:502:llog_process_th.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755968.012725:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 174 00010000:00010000:0.0:1784755968.030882:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755969.055088:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784755969.247736:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784755969.247745:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fce44a76800 from 4 10000000:01000000:0.0:1784755969.247749:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784755969.247793:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.247816:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.247829:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755969.247856:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.248041:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755969.248092:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44f43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784755969.248118:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348224 00000100:00100000:1.0:1784755969.248125:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348224 00000100:00100000:1.0:1784755969.248176:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784755969.248551:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153348224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755969.248565:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755969.248578:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c365f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.248602:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.248612:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.248620:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82150000, rc 0) 00000100:00100000:1.0:1784755969.248751:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 566us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755969.248758:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784755969.248874:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80773100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755969.249103:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.249114:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755969.249181:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.249230:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.250146:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.250823:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348352 00000100:00100000:0.0:1784755969.250835:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348352 00000100:00100000:0.0:1784755969.250889:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784755969.250899:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.251301:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755969.251308:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784755969.251352:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.251399:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.251444:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.252137:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.254768:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348480 00000100:00100000:0.0:1784755969.254781:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348480 00000100:00100000:0.0:1784755969.254850:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784755969.254869:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.255307:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755969.255316:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784755969.255520:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755969.257500:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8422:1871452153348608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755969.257583:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755969.257633:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.257783:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348608 00000100:00100000:0.0:1784755969.257791:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348608 00000100:00100000:0.0:1784755969.257846:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784755969.257856:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8422:x1871452153348608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755969.258901:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8422:x1871452153348608:12345-0@lo:502:llog_process_th.0 Request processed in 1042us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755969.259559:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8422:1871452153348608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784755969.259604:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755969.259617:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755969.259620:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784755969.259629:0:8422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fce44a76800 00000020:00000080:3.0:1784755969.259632:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784755969.259756:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784755969.260144:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8422:1871452153348736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755969.261031:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755969.261076:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348736 00000100:00100000:3.0:1784755969.261083:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348736 00000100:00100000:3.0:1784755969.261126:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784755969.261134:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8422:x1871452153348736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755969.261347:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:8422:x1871452153348736:12345-0@lo:502:llog_process_th.0 Request processed in 212us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755969.261355:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784755969.261414:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf44e100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755969.261435:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8422:1871452153348736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784755969.261467:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755969.261473:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755969.261475:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784755969.261480:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784755969.270360:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784755969.270394:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784755969.270406:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.270420:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755969.270430:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784755969.270432:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf463c1000 from 4 10000000:01000000:0.0:1784755969.270435:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784755969.270470:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.270478:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.270488:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755969.270521:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80772300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.270583:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755969.270621:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf462f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.274159:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348864 00000100:00100000:0.0:1784755969.274170:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348864 00000100:00100000:0.0:1784755969.274784:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784755969.274794:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153348864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755969.274821:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755969.274841:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c366d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.274870:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.274881:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755969.274890:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c1000, rc 0) 00000100:00100000:0.0:1784755969.275331:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153348864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 536us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755969.275339:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784755969.275456:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80772300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755969.275476:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.275488:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755969.275555:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.275586:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.275623:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.276097:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153348992 00000100:00100000:0.0:1784755969.276104:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153348992 00000100:00100000:0.0:1784755969.276129:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784755969.276136:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153348992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.277213:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153348992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1072us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755969.277229:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784755969.280185:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.280249:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.280329:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.280372:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755969.280392:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349120 00000100:00100000:1.0:1784755969.280398:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349120 00000100:00100000:1.0:1784755969.280437:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784755969.280445:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153349120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.280716:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153349120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755969.280731:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784755969.280777:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755969.292129:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8425:1871452153349248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755969.292218:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755969.292257:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349248 00000100:00100000:0.0:1784755969.292264:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349248 00000100:00100000:0.0:1784755969.292307:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784755969.292315:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8425:x1871452153349248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755969.292524:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8425:x1871452153349248:12345-0@lo:502:llog_process_th.0 Request processed in 209us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755969.292533:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784755969.292580:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf43334d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755969.292601:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8425:1871452153349248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755969.292669:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755969.292678:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755969.292680:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784755969.292687:0:8425:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fcf463c1000 00000020:00000080:0.0:1784755969.292690:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784755969.294143:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8425:1871452153349376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755969.294205:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755969.300717:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf43334d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755969.305251:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349376 00000100:00100000:2.0:1784755969.305267:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349376 00000100:00100000:2.0:1784755969.305324:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784755969.305334:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8425:x1871452153349376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755969.305572:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:8425:x1871452153349376:12345-0@lo:502:llog_process_th.0 Request processed in 239us (11365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755969.305580:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784755969.312937:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8425:1871452153349376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755969.313001:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755969.313012:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755969.313017:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784755969.313024:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784755969.313096:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784755969.313118:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784755969.313131:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313144:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755969.313154:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784755969.313157:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf4549c800 from 4 10000000:01000000:1.0:1784755969.313160:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784755969.313196:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313204:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313213:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755969.313234:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.313303:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.313337:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755969.313355:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349504 00000100:00100000:1.0:1784755969.313361:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349504 00000100:00100000:1.0:1784755969.313404:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784755969.313413:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153349504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755969.313427:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755969.313439:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c367b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313462:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313473:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313482:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf82150400, rc 0) 00000100:00100000:1.0:1784755969.313517:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153349504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755969.313524:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784755969.313560:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755969.313571:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755969.313581:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755969.313621:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.313673:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.313685:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf807443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755969.313698:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349632 00000100:00100000:1.0:1784755969.313701:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349632 00000100:00100000:1.0:1784755969.313720:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784755969.313726:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153349632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.314985:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153349632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1253us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755969.314997:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784755969.315264:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755969.315305:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755969.315351:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755969.315374:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf4636c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784755969.315388:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349760 00000100:00100000:3.0:1784755969.315393:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349760 00000100:00100000:3.0:1784755969.315424:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784755969.315432:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153349760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755969.315575:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153349760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755969.315581:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784755969.315619:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153349760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755969.316187:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8427:1871452153349888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755969.316223:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.316239:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744600 going to sleep for 11 seconds 00000100:00100000:3.0:1784755969.316307:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153349888 00000100:00100000:3.0:1784755969.316312:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153349888 00000100:00100000:3.0:1784755969.316337:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784755969.316342:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:8427:x1871452153349888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755969.316474:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:8427:x1871452153349888:12345-0@lo:502:llog_process_th.0 Request processed in 131us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755969.316482:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784755969.316581:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8427:1871452153349888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755969.316607:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755969.316616:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755969.316618:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784755969.316628:0:8427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fcf4549c800 00000020:00000080:1.0:1784755969.316631:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784755969.317053:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8427:1871452153350016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755969.317090:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755969.317102:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf80744600 going to sleep for 11 seconds 00000100:00100000:3.0:1784755969.318226:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350016 00000100:00100000:3.0:1784755969.318246:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350016 00000100:00100000:3.0:1784755969.318287:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784755969.318296:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:8427:x1871452153350016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755969.318497:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:8427:x1871452153350016:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755969.318505:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784755969.318878:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:8427:1871452153350016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755969.318914:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755969.318921:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755969.318923:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784755969.318927:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784755969.320154:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784755969.320181:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784755969.320193:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755969.320206:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755970.079630:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755970.972910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755970.972949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755970.972988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755970.973024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755970.973052:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545024 00000100:00100000:0.0:1784755970.973052:0:7966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545152 00000100:00100000:1.0:1784755970.973073:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545024 00000100:00100000:0.0:1784755970.973073:0:7966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545152 00000100:00100000:0.0:1784755970.973130:0:7966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:2.0:1784755970.973139:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544896 00000100:00100000:0.0:1784755970.973140:0:7966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136545152:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784755970.973153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544896 00000100:00100000:3.0:1784755970.973246:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136544768 00000100:00100000:3.0:1784755970.973251:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136544768 00000100:00100000:3.0:1784755970.973281:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 190 00000100:00100000:3.0:1784755970.973288:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136544768:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784755970.973346:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136544768:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 58us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755970.973353:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 190 00000100:00100000:0.0:1784755970.973922:0:7966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136545152:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 781us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755970.973931:0:7966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:0.0:1784755970.973946:0:7966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13 00000100:00100000:0.0:1784755970.973952:0:7966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136545024:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784755970.973979:0:7966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136545024:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 27us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755970.973985:0:7966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13 00000100:00100000:2.0:1784755970.974296:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 27 00000100:00100000:2.0:1784755970.974305:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136544896:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784755970.974351:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136544896:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 48us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.974357:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 27 00000100:00080000:3.0:1784755970.977418:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784755970.977429:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784755970.977432:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784755971.104313:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755971.870861:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153350144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784755971.870937:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755971.871474:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350144 00000100:00100000:2.0:1784755971.871483:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350144 00000100:00080000:3.0:1784755971.871618:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784755971.871950:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755971.871963:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153350144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784755971.871999:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755971.872072:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153350144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755971.872080:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1784755971.872167:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7b8fea00 x1871452153350144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755971.872188:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153350144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784755971.874380:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153350272:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874438:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755971.874469:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153350784:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755971.874516:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784755971.874522:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153350656:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874545:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755971.874568:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350272 00000100:00100000:3.0:1784755971.874574:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350272 00000100:00100000:3.0:1784755971.874604:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784755971.874610:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874672:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153350272:12345-0@lo:400:kworker.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755971.874679:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784755971.874710:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350784 00000100:00100000:3.0:1784755971.874713:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350784 00000100:00100000:3.0:1784755971.874739:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784755971.874743:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874766:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153350784:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755971.874770:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784755971.874792:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350656 00000100:00100000:3.0:1784755971.874795:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350656 00000100:00100000:3.0:1784755971.874830:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784755971.874836:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874872:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153350656:12345-0@lo:400:kworker.0 Request processed in 36us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755971.874887:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1784755971.874911:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784755971.874915:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784755971.874945:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf60437100 x1871452153350656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755971.874959:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153350656:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874969:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153350272:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.874978:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153350784:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875021:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153350400:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875046:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755971.875078:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784755971.875084:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153350528:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875104:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755971.875142:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350400 00000100:00100000:3.0:1784755971.875145:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350400 00000100:00100000:3.0:1784755971.875412:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350528 00000100:00100000:3.0:1784755971.875416:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350528 00000100:00100000:3.0:1784755971.875440:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784755971.875446:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875485:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153350400:12345-0@lo:400:kworker.0 Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755971.875491:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784755971.875501:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784755971.875507:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875548:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153350528:12345-0@lo:400:kworker.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755971.875553:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784755971.875567:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755971.875587:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153350528:0@lo:400:kworker.0 00000100:00100000:3.0:1784755971.875595:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153350400:0@lo:400:kworker.0 00010000:00010000:1.0:1784755972.128971:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755972.895726:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153350912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784755972.895817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755972.895919:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153350912 00000100:00100000:2.0:1784755972.895927:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153350912 00000100:00100000:2.0:1784755972.895971:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755972.895980:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153350912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784755972.896014:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755972.896057:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153350912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755972.896064:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784755972.896118:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80770700 x1871452153350912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755972.896137:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153350912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784755973.151162:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755974.178358:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784755974.335242:0:8659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1784755975.203664:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755976.100402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755976.100464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755976.100512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755976.100553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755976.100611:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545280 00000100:00100000:3.0:1784755976.100621:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545280 00000100:00100000:3.0:1784755976.100703:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 192 00000100:00100000:3.0:1784755976.100713:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136545280:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784755976.100805:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136545280:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 93us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755976.100813:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 192 00000100:00100000:0.0:1784755976.100982:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545408 00000100:00100000:0.0:1784755976.100987:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545408 00000100:00100000:0.0:1784755976.101030:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 31 00000100:00100000:0.0:1784755976.101036:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136545408:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784755976.101071:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136545408:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.101077:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 31 00000100:00080000:3.0:1784755976.102557:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784755976.108246:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545536 00000100:00100000:1.0:1784755976.108262:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545536 00000100:00100000:1.0:1784755976.108361:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545664 00000100:00100000:1.0:1784755976.108365:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545664 00000100:00100000:1.0:1784755976.108403:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:1.0:1784755976.108412:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136545536:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784755976.108496:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136545536:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 84us (8030us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.108503:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:1.0:1784755976.108519:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 16 00000100:00100000:1.0:1784755976.108525:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136545664:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784755976.108551:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2357:x1871452136545664:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 27us (7999us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.108556:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 16 00000100:00080000:3.0:1784755976.109027:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784755976.109032:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784755976.223116:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755976.990944:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755976.990976:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7b8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784755976.991038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.991106:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351040 00000100:00100000:2.0:1784755976.991113:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351040 00000100:00100000:2.0:1784755976.991164:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784755976.991172:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153351040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784755976.991204:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755976.991244:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153351040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.991251:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784755976.991270:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784755976.991298:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7b8fd180 x1871452153351040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755976.991316:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7b8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784755976.991491:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153351168:0@lo:400:kworker.0 00000100:00100000:0.0:1784755976.991530:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755976.991552:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153351680:0@lo:400:kworker.0 00000100:00100000:0.0:1784755976.991574:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755976.991590:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784755976.991595:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153351296:0@lo:400:kworker.0 00000100:00100000:0.0:1784755976.991613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755976.991654:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351168 00000100:00100000:0.0:1784755976.991659:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351168 00000100:00100000:0.0:1784755976.991788:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784755976.991796:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153351168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755976.991829:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153351168:12345-0@lo:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.991835:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784755976.991861:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351680 00000100:00100000:0.0:1784755976.991864:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351680 00000100:00100000:0.0:1784755976.991890:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351296 00000100:00100000:0.0:1784755976.991893:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351296 00000100:00100000:0.0:1784755976.991909:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784755976.991915:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153351680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755976.991942:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153351680:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.991948:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784755976.996126:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153351552:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.996252:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784755976.996259:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153351424:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996284:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.996316:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351552 00000100:00100000:1.0:1784755976.996323:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351552 00000100:00100000:1.0:1784755976.996374:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784755976.996383:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153351552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996434:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153351552:12345-0@lo:400:kworker.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.996455:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1784755976.996499:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80770700 x1871452153351552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755976.996513:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153351552:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996583:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351424 00000100:00100000:1.0:1784755976.996587:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351424 00000100:00100000:1.0:1784755976.996611:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784755976.996618:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153351296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996679:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153351296:12345-0@lo:400:kworker.0 Request processed in 63us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.996696:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784755976.996709:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784755976.996714:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153351424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.996755:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153351424:12345-0@lo:400:kworker.0 Request processed in 41us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.996761:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784755976.997528:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153351296:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.997540:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153351168:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.997551:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153351680:0@lo:400:kworker.0 00000100:00100000:1.0:1784755976.997591:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153351424:0@lo:400:kworker.0 00000100:00080000:2.0:1784755976.998394:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784755976.998401:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784755977.250865:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755978.017910:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153351808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784755978.017982:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755978.018418:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351808 00000100:00100000:0.0:1784755978.018427:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351808 00000100:00100000:0.0:1784755978.018484:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755978.018494:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153351808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784755978.018538:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755978.018589:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153351808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755978.018597:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1784755978.018666:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80771500 x1871452153351808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755978.018686:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153351808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784755978.020120:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784755978.273976:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784755978.710130:0:8903:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing yml_node 00010000:00010000:0.0:1784755979.295261:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755980.318873:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755981.214340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755981.214438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755981.214866:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545920 00000100:00100000:1.0:1784755981.214877:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545920 00000100:00100000:1.0:1784755981.214970:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 35 00000100:00100000:1.0:1784755981.214995:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136545920:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784755981.215086:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136545920:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 93us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.215094:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 35 00000100:00080000:2.0:1784755981.215432:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755981.216327:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136545792 00000100:00100000:3.0:1784755981.216336:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136545792 00000100:00100000:3.0:1784755981.216423:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 194 00000100:00100000:3.0:1784755981.216431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136545792:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784755981.216483:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136545792:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 53us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.216503:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 194 00000100:00100000:2.0:1784755981.222114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755981.222322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784755981.222996:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546048 00000100:00100000:3.0:1784755981.223006:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546048 00000100:00100000:3.0:1784755981.223105:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546176 00000100:00100000:3.0:1784755981.223109:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546176 00000100:00100000:1.0:1784755981.223174:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 10 00000100:00100000:1.0:1784755981.223186:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2353:x1871452136546048:12345-192.168.202.8@tcp:9:kworker.0 00000020:00000080:1.0:1784755981.223225:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8f2fc1536a2c35be 00000100:00080000:1.0:1784755981.223235:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8fcf46351800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784755981.223273:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784755981.223666:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+2:2353:x1871452136546048:12345-192.168.202.8@tcp:9:kworker.0 Request processed in 481us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.223675:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 10 00010000:00010000:1.0:1784755981.223708:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784755981.225048:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784755981.225055:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755981.226335:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 11 00000100:00100000:3.0:1784755981.226350:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2353:x1871452136546176:12345-192.168.202.8@tcp:9:kworker.0 00000020:00000080:3.0:1784755981.226390:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8f2fc1536a2c35c5 00000100:00080000:3.0:1784755981.226400:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8fce46f3c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784755981.226454:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1784755981.226688:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755981.227227:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+2:2353:x1871452136546176:12345-192.168.202.8@tcp:9:kworker.0 Request processed in 880us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.227236:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 11 00010000:00010000:1.0:1784755981.343004:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755982.110867:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153352064:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.110954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755982.111042:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153351936:0@lo:400:kworker.0 00000100:00100000:2.0:1784755982.111078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755982.111194:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153352192:0@lo:400:kworker.0 00000100:00100000:3.0:1784755982.111223:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755982.113337:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153352576:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113393:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755982.113451:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153352320:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113476:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755982.113508:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352064 00000100:00100000:0.0:1784755982.113529:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352064 00000100:00100000:0.0:1784755982.113570:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352192 00000100:00100000:0.0:1784755982.113574:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352192 00000100:00100000:0.0:1784755982.113604:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784755982.113613:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153352064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113678:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153352064:12345-0@lo:400:kworker.0 Request processed in 66us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755982.113685:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784755982.113724:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784755982.113731:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153352192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113762:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153352192:12345-0@lo:400:kworker.0 Request processed in 32us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755982.113768:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784755982.113786:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352576 00000100:00100000:0.0:1784755982.113790:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352576 00000100:00100000:0.0:1784755982.113816:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352320 00000100:00100000:0.0:1784755982.113819:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352320 00000100:00100000:0.0:1784755982.113840:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755982.113846:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153352576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113878:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153352576:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755982.113885:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755982.113896:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784755982.113902:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153352320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.113937:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153352320:12345-0@lo:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755982.113943:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1784755982.113990:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80770000 x1871452153352320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755982.115777:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153352064:0@lo:400:kworker.0 00010000:00080000:1.0:1784755982.115795:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80770700 x1871452153352576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755982.115806:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153352576:0@lo:400:kworker.0 00000100:00100000:2.0:1784755982.116018:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153351936 00000100:00100000:2.0:1784755982.116024:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153351936 00000100:00100000:2.0:1784755982.116064:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784755982.116072:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153351936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755982.116136:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf50c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153351936:12345-0@lo:400:kworker.0 Request processed in 64us (5056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755982.116143:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1784755982.116173:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784755982.116177:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784755982.116180:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755982.116285:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153352448:0@lo:400:kworker.0 00000100:00100000:2.0:1784755982.116317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755982.116348:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153351936:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.116465:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153352320:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.116490:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352448 00000100:00100000:0.0:1784755982.116493:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352448 00000100:00100000:0.0:1784755982.116596:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784755982.116603:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153352448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.116672:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153352448:12345-0@lo:400:kworker.0 Request processed in 70us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755982.116678:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1784755982.118013:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755982.118048:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153352448:0@lo:400:kworker.0 00000100:00100000:0.0:1784755982.118164:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784755982.118176:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153352704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784755982.118223:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755982.118293:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352704 00000100:00100000:2.0:1784755982.118298:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352704 00000100:00100000:2.0:1784755982.118345:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784755982.118354:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153352704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784755982.118382:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755982.118425:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153352704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755982.118432:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1784755982.118483:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab4380 x1871452153352704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755982.118498:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153352704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784755982.118854:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153352192:0@lo:400:kworker.0 00000001:02000400:0.0:1784755982.223475:0:9094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00010000:00010000:1.0:1784755982.367748:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755983.137932:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784755983.137954:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153352832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784755983.138141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755983.138266:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352832 00000100:00100000:0.0:1784755983.138274:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352832 00000100:00100000:0.0:1784755983.138327:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784755983.138337:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153352832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784755983.138374:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755983.138420:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153352832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755983.138426:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1784755983.138699:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf60436680 x1871452153352832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755983.138719:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153352832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784755983.390964:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784755984.219098:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000020:00000080:3.0:1784755984.219107:0:7498:0:(genops.c:906:class_export_put()) final put ffff8fce46f3c800/48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000020:00000080:3.0:1784755984.219152:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8fce46f3c800/48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 for lustre-OST0001 00000020:00000080:3.0:1784755984.219194:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8fce46f3c000 for lustre-OST0001 00010000:00010000:1.0:1784755984.415245:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784755984.449412:0:9194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00000001:00100000:3.0:1784755984.714870:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000020:00000080:3.0:1784755984.714880:0:6615:0:(genops.c:906:class_export_put()) final put ffff8fcf46352000/48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000020:00000080:1.0:1784755984.714940:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8fcf46352000/48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 for lustre-OST0000 00000020:00000080:1.0:1784755984.714986:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8fcf46351800 for lustre-OST0000 00010000:00010000:1.0:1784755985.438949:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755986.345815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784755986.345855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755986.345911:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546432 00000100:00100000:1.0:1784755986.345921:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546432 00000100:00100000:1.0:1784755986.345978:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 39 00000100:00100000:1.0:1784755986.345986:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136546432:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784755986.346071:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136546432:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.346078:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 39 00000100:00080000:2.0:1784755986.346376:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784755986.347747:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546304 00000100:00100000:0.0:1784755986.347768:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546304 00000100:00100000:0.0:1784755986.347819:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 196 00000100:00100000:0.0:1784755986.347828:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136546304:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784755986.347885:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136546304:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 58us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.347892:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 196 00010000:00010000:1.0:1784755986.463537:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784755986.633572:0:9291:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00000100:00100000:0.0:1784755987.230972:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153353344:0@lo:400:kworker.0 00000100:00100000:0.0:1784755987.231038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755987.231096:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784755987.231101:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153353216:0@lo:400:kworker.0 00000100:00100000:0.0:1784755987.231136:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755987.231165:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353344 00000100:00100000:0.0:1784755987.231171:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353344 00000100:00100000:0.0:1784755987.231218:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784755987.231225:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755987.231268:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153353344:12345-0@lo:400:kworker.0 Request processed in 44us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.231274:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784755987.231292:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353216 00000100:00100000:0.0:1784755987.231294:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353216 00000100:00100000:0.0:1784755987.231315:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784755987.231320:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153353216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755987.231343:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153353216:12345-0@lo:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.231349:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784755987.231379:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153353216:0@lo:400:kworker.0 00010000:00080000:0.0:1784755987.231390:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c068e00 x1871452153353344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755987.231400:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153353344:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.231874:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153352960:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.231915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755987.231952:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153353472:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.231988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755987.232019:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784755987.232026:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153353088:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755987.232080:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153353600:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784755987.232127:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784755987.232131:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784755987.232141:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353472 00000100:00100000:2.0:1784755987.232146:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353472 00000100:00100000:2.0:1784755987.232177:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353088 00000100:00100000:2.0:1784755987.232180:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353088 00000100:00100000:2.0:1784755987.232197:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784755987.232203:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153353472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232242:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153353472:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755987.232249:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784755987.232262:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784755987.232268:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153353088:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755987.232300:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784755987.232328:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353600 00000100:00100000:2.0:1784755987.232331:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353600 00000100:00100000:2.0:1784755987.232372:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784755987.232379:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7b8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153353600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232422:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7b8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153353600:12345-0@lo:400:kworker.0 Request processed in 44us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755987.232428:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1784755987.232444:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784755987.232447:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755987.232469:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153353088:0@lo:400:kworker.0 00010000:00080000:2.0:1784755987.232479:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c06a300 x1871452153353600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755987.232488:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153353600:0@lo:400:kworker.0 00000100:00100000:2.0:1784755987.232497:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153353472:0@lo:400:kworker.0 00000100:00100000:3.0:1784755987.233354:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153353728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784755987.233505:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755987.233581:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353728 00000100:00100000:1.0:1784755987.233587:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353728 00000100:00100000:0.0:1784755987.233594:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153352960 00000100:00100000:0.0:1784755987.233600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153352960 00000100:00100000:1.0:1784755987.233629:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784755987.233669:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784755987.233673:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153353728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784755987.233681:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153352960:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1784755987.233707:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755987.233738:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153352960:12345-0@lo:400:kworker.0 Request processed in 61us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.233755:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784755987.233818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153352960:0@lo:400:kworker.0 00000100:00100000:1.0:1784755987.234075:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153353728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 437us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755987.234082:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1784755987.234139:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dfb80 x1871452153353728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755987.234155:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153353728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784755987.487370:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784755988.008965:0:9339:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Jul 22 17:33:07 EDT 2026 00000100:00100000:2.0:1784755988.259202:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153353856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784755988.259270:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755988.259342:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353856 00000100:00100000:2.0:1784755988.259350:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353856 00000100:00100000:2.0:1784755988.259397:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784755988.259406:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153353856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784755988.259439:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755988.259480:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153353856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755988.259486:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1784755988.259778:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605df800 x1871452153353856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755988.259796:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153353856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784755988.513092:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755989.536060:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755990.559803:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755991.457672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755991.457719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784755991.457748:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546560 00000100:00100000:1.0:1784755991.457756:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546560 00000100:00100000:1.0:1784755991.457801:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 198 00000100:00100000:1.0:1784755991.457810:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2355:x1871452136546560:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784755991.457897:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2355:x1871452136546560:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755991.457905:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 198 00000100:00100000:3.0:1784755991.458064:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546688 00000100:00100000:3.0:1784755991.458068:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546688 00000100:00100000:3.0:1784755991.458117:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 43 00000100:00100000:3.0:1784755991.458124:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2355:x1871452136546688:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784755991.458164:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2355:x1871452136546688:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755991.458170:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 43 00000100:00080000:1.0:1784755991.458260:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784755991.582998:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755992.350917:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153354368:0@lo:400:kworker.0 00000100:00100000:2.0:1784755992.350991:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755992.351045:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755992.351050:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153354240:0@lo:400:kworker.0 00000100:00100000:2.0:1784755992.351071:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755992.351100:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354240 00000100:00100000:2.0:1784755992.351106:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354240 00000100:00100000:2.0:1784755992.351155:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784755992.351165:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153354240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755992.351222:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153354240:12345-0@lo:400:kworker.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755992.351229:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1784755992.351251:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755992.351275:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153354240:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351419:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153354112:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351448:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.351474:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153354624:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.351525:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784755992.351530:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153353984:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351557:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.351575:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153354496:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351624:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.351674:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354112 00000100:00100000:1.0:1784755992.351678:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354112 00000100:00100000:1.0:1784755992.351704:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354496 00000100:00100000:1.0:1784755992.351707:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354496 00000100:00100000:1.0:1784755992.351726:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784755992.351731:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153354112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351764:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153354112:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755992.351771:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784755992.351783:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784755992.351789:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153354496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351814:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153354496:12345-0@lo:400:kworker.0 Request processed in 25us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755992.351834:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784755992.351860:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153354496:0@lo:400:kworker.0 00000100:00100000:1.0:1784755992.351869:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153354112:0@lo:400:kworker.0 00000100:00100000:0.0:1784755992.352043:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354368 00000100:00100000:0.0:1784755992.352048:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354368 00000100:00100000:0.0:1784755992.352086:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354624 00000100:00100000:0.0:1784755992.352089:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354624 00000100:00100000:0.0:1784755992.352110:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755992.352116:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755992.352153:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153354368:12345-0@lo:400:kworker.0 Request processed in 38us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.352159:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755992.352168:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784755992.352173:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153354624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755992.352200:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153354624:12345-0@lo:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.352205:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784755992.352221:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153353984 00000100:00100000:0.0:1784755992.352224:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153353984 00000100:00100000:0.0:1784755992.352244:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784755992.352249:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153353984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784755992.352273:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153353984:12345-0@lo:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.352278:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:0.0:1784755992.352315:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605ddf80 x1871452153354368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755992.352333:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153354368:0@lo:400:kworker.0 00000100:00100000:0.0:1784755992.352369:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153353984:0@lo:400:kworker.0 00010000:00080000:0.0:1784755992.352379:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dd500 x1871452153354624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755992.352386:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153354624:0@lo:400:kworker.0 00000100:00100000:3.0:1784755992.353030:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153354752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784755992.353067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.353142:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354752 00000100:00100000:1.0:1784755992.353146:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354752 00000100:00100000:1.0:1784755992.353184:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784755992.353191:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153354752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784755992.353228:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755992.353266:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153354752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755992.353272:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784755992.353435:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784755992.353439:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784755992.353441:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784755992.353556:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab5500 x1871452153354752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755992.353586:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153354752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784755992.609344:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755993.375728:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153354880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784755993.375811:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755993.378266:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153354880 00000100:00100000:1.0:1784755993.378279:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153354880 00000100:00100000:1.0:1784755993.378329:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784755993.378348:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153354880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784755993.378393:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755993.378464:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153354880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755993.378471:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1784755993.378514:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dc380 x1871452153354880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755993.378533:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153354880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784755993.644134:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755994.659609:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755995.678994:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755996.573076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755996.573129:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546816 00000100:00100000:1.0:1784755996.573131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784755996.573139:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546816 00000100:00100000:0.0:1784755996.573189:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 200 00000100:00100000:0.0:1784755996.573199:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136546816:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784755996.573266:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136546816:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755996.573274:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 200 00000100:00100000:3.0:1784755996.580231:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136546944 00000100:00100000:3.0:1784755996.580244:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136546944 00000100:00080000:0.0:1784755996.580369:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755996.581180:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 47 00000100:00100000:3.0:1784755996.581192:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136546944:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784755996.581276:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136546944:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 86us (8143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.581284:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 47 00010000:00010000:0.0:1784755996.712600:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755997.473601:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784755997.473627:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153355008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784755997.473720:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.473782:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355008 00000100:00100000:1.0:1784755997.473789:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355008 00000100:00100000:1.0:1784755997.474003:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784755997.474015:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153355008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784755997.474050:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755997.474095:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153355008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755997.474102:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1784755997.474122:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784755997.474147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab7b80 x1871452153355008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755997.474164:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153355008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784755997.474366:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153355264:0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.474416:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755997.474455:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355264 00000100:00100000:3.0:1784755997.474459:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355264 00000100:00100000:3.0:1784755997.474489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784755997.474494:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153355264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.474530:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153355264:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.474536:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784755997.474580:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153355264:0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.474612:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153355392:0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.474667:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755997.474696:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355392 00000100:00100000:3.0:1784755997.474701:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355392 00000100:00100000:3.0:1784755997.474729:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784755997.474735:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153355392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.474778:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153355392:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.474784:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1784755997.474801:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755997.474818:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153355392:0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.474973:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755997.474983:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153355136:0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.475019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.475054:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355136 00000100:00100000:2.0:1784755997.475058:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355136 00000100:00100000:2.0:1784755997.475088:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784755997.475094:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153355136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.475128:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153355136:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.475142:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784755997.475194:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf60436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153355136:0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.475387:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153355520:0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.475417:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.475446:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755997.475452:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153355648:0@lo:400:kworker.0 00000100:00100000:2.0:1784755997.475474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755997.475542:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355520 00000100:00100000:3.0:1784755997.475546:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355520 00000100:00100000:3.0:1784755997.475604:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755997.475612:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153355520:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784755997.475728:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755997.475782:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153355520:12345-0@lo:400:kworker.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.475789:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755997.475811:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355648 00000100:00100000:3.0:1784755997.475815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355648 00000100:00100000:3.0:1784755997.475930:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784755997.475937:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153355648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784755997.475972:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153355648:12345-0@lo:400:kworker.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.475979:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1784755997.475997:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755997.476057:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153355648:0@lo:400:kworker.0 00010000:00080000:2.0:1784755997.476069:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42fbe300 x1871452153355520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755997.476079:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153355520:0@lo:400:kworker.0 00010000:00010000:1.0:1784755997.728485:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755998.495484:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755998.495507:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153355776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784755998.495588:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755998.495663:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355776 00000100:00100000:2.0:1784755998.495670:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355776 00000100:00100000:2.0:1784755998.495713:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784755998.495720:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153355776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784755998.495753:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755998.495790:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153355776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755998.495797:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1784755998.495833:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605df480 x1871452153355776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755998.495869:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153355776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784755998.753083:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755999.777302:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756000.799854:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756001.708924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756001.708968:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756001.709091:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547072 00000100:00100000:2.0:1784756001.709101:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547072 00000100:00100000:2.0:1784756001.709159:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 202 00000100:00100000:2.0:1784756001.709169:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136547072:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756001.709239:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136547072:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756001.709246:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 202 00000100:00100000:3.0:1784756001.710443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547200 00000100:00100000:3.0:1784756001.710452:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547200 00000100:00100000:3.0:1784756001.710537:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 51 00000100:00100000:3.0:1784756001.710546:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136547200:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784756001.710620:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136547200:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 76us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756001.710661:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 51 00000100:00080000:2.0:1784756001.711248:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756001.825164:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756002.590920:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153356160:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.590945:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153356032:0@lo:400:kworker.0 00000100:00100000:1.0:1784756002.591012:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.591017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756002.591090:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153355904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756002.591114:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153356672:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.591165:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153356288:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.595220:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153356544:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.595302:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.595368:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356032 00000100:00100000:2.0:1784756002.595385:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356032 00000100:00100000:2.0:1784756002.595431:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784756002.595439:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153356032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.595496:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153356032:12345-0@lo:400:kworker.0 Request processed in 57us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.595513:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784756002.598757:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153356032:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.598824:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356160 00000100:00100000:2.0:1784756002.598832:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356160 00000100:00100000:2.0:1784756002.598959:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356544 00000100:00100000:2.0:1784756002.599099:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356544 00000100:00100000:2.0:1784756002.599136:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756002.599145:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153356160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.599234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153356160:12345-0@lo:400:kworker.0 Request processed in 90us (8223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.599241:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756002.599255:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784756002.599261:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153356544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.599293:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153356544:12345-0@lo:400:kworker.0 Request processed in 32us (3992us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.599299:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1784756002.599317:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756002.599343:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153356544:0@lo:400:kworker.0 00000100:00100000:3.0:1784756002.605429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756002.605773:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153356416:0@lo:400:kworker.0 00000100:00100000:3.0:1784756002.605826:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.605950:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153355904 00000100:00100000:2.0:1784756002.605963:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153355904 00000100:00100000:2.0:1784756002.606110:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756002.606123:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153355904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756002.606721:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756002.606781:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153355904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 661us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.606790:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1784756002.606819:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756002.607750:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab7b80 x1871452153355904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756002.607775:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153355904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756002.608298:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356416 00000100:00100000:2.0:1784756002.608306:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356416 00000100:00100000:2.0:1784756002.608950:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756002.608977:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153356416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.609069:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153356416:12345-0@lo:400:kworker.0 Request processed in 110us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.609101:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784756002.609128:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756002.612959:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756002.613401:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153356160:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.613495:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356672 00000100:00100000:2.0:1784756002.613514:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356672 00000100:00100000:2.0:1784756002.613578:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756002.613591:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153356672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.613704:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153356672:12345-0@lo:400:kworker.0 Request processed in 118us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.613712:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1784756002.613880:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dc700 x1871452153356672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756002.613907:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153356672:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.624927:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.625927:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356288 00000100:00100000:2.0:1784756002.625940:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356288 00000100:00100000:2.0:1784756002.626032:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756002.626053:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153356288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.626143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153356288:12345-0@lo:400:kworker.0 Request processed in 93us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.626150:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784756002.626499:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756002.626550:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153356288:0@lo:400:kworker.0 00010000:00080000:3.0:1784756002.633806:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dc380 x1871452153356416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756002.633826:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153356416:0@lo:400:kworker.0 00010000:00010000:1.0:1784756002.848946:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756003.617896:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153356800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756003.617973:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756003.618389:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356800 00000100:00100000:2.0:1784756003.618397:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356800 00000100:00100000:2.0:1784756003.618454:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756003.618465:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153356800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756003.618508:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756003.618560:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153356800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.618567:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784756003.618686:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dd500 x1871452153356800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756003.618704:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153356800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756003.870884:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756004.903927:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756005.920278:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756006.622430:0:10068:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682551 <= 34618625) for LU-18938, skip 360 00000100:00100000:0.0:1784756006.818894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756006.818974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756006.819036:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547456 00000100:00100000:3.0:1784756006.819047:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547456 00000100:00100000:3.0:1784756006.819155:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 55 00000100:00100000:3.0:1784756006.819167:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136547456:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784756006.819248:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136547456:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756006.819255:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 55 00000100:00100000:2.0:1784756006.819289:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547328 00000100:00100000:2.0:1784756006.819293:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547328 00000100:00100000:2.0:1784756006.819323:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 204 00000100:00100000:2.0:1784756006.819337:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136547328:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756006.819366:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136547328:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756006.819372:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 204 00000100:00080000:0.0:1784756006.819430:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756006.946696:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756007.712154:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153357312:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712211:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712261:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784756007.712265:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153356928:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712284:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712299:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153357440:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712314:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712332:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153357056:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712369:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153357568:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712416:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756007.712419:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153357184:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756007.712468:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357312 00000100:00100000:0.0:1784756007.712474:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357312 00000100:00100000:0.0:1784756007.712520:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357568 00000100:00100000:0.0:1784756007.712523:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357568 00000100:00100000:0.0:1784756007.712546:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756007.712554:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153357312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712599:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153357312:12345-0@lo:400:kworker.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.712611:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756007.712625:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756007.712631:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153357568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712685:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153357568:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.712691:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756007.712705:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153356928 00000100:00100000:0.0:1784756007.712707:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153356928 00000100:00100000:0.0:1784756007.712723:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784756007.712726:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153356928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712745:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153356928:12345-0@lo:400:kworker.0 Request processed in 18us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.712749:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784756007.712774:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357440 00000100:00100000:0.0:1784756007.712777:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357440 00000100:00100000:0.0:1784756007.712802:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357056 00000100:00100000:0.0:1784756007.712805:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357056 00000100:00100000:0.0:1784756007.712814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357184 00000100:00100000:0.0:1784756007.712815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357184 00000100:00100000:0.0:1784756007.712828:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784756007.712833:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712862:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153357440:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.712869:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784756007.712881:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756007.712886:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153357056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.712920:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153357056:12345-0@lo:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.712926:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756007.712937:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784756007.712943:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153357184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.714129:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153357184:12345-0@lo:400:kworker.0 Request processed in 1180us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.714138:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1784756007.714173:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756007.714177:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756007.714180:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756007.714221:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153357184:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.714231:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153357056:0@lo:400:kworker.0 00010000:00080000:0.0:1784756007.714244:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c068380 x1871452153357568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756007.714255:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153357568:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.714289:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153356928:0@lo:400:kworker.0 00000100:00100000:0.0:1784756007.714299:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153357440:0@lo:400:kworker.0 00010000:00080000:0.0:1784756007.714310:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c068700 x1871452153357312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756007.714318:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153357312:0@lo:400:kworker.0 00000100:00100000:2.0:1784756007.722223:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756007.722305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756007.728708:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357696 00000100:00100000:2.0:1784756007.728724:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357696 00000100:00100000:2.0:1784756007.728786:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784756007.728796:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153357696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756007.728836:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756007.728921:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153357696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (6615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756007.728929:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784756007.729147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd75880 x1871452153357696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756007.729167:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153357696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756007.967811:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756007.992634:0:10117:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682551 < 34486116) for LU-14927, skip 0f 00000100:00100000:1.0:1784756008.734821:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756008.734846:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153357824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756008.734927:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756008.735103:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357824 00000100:00100000:3.0:1784756008.735110:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357824 00000100:00100000:3.0:1784756008.735163:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784756008.735172:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153357824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756008.735205:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756008.735255:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153357824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756008.735262:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1784756008.735298:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42ab6a00 x1871452153357824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756008.735316:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42ab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153357824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756008.999092:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756009.416800:0:10165:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682551 < 34681754) for LU-12550, skip 216 00010000:00010000:0.0:1784756010.015170:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756010.874331:0:10213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00010000:00010000:1.0:1784756011.039015:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756011.930962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756011.934247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756011.934394:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547712 00000100:00100000:1.0:1784756011.934408:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547712 00000100:00100000:1.0:1784756011.934521:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 59 00000100:00100000:1.0:1784756011.934535:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136547712:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756011.934658:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136547712:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756011.934668:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 59 00000100:00100000:0.0:1784756011.936157:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547584 00000100:00100000:0.0:1784756011.936172:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547584 00000100:00100000:0.0:1784756011.936257:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 206 00000100:00100000:0.0:1784756011.936268:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136547584:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756011.936348:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136547584:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 81us (5402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756011.936357:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 206 00000100:00080000:3.0:1784756011.940459:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784756012.066515:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756012.575778:0:10261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00000100:00100000:3.0:1784756012.831751:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153357952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756012.831873:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832094:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153357952 00000100:00100000:2.0:1784756012.832105:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153357952 00000100:00100000:2.0:1784756012.832184:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756012.832197:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153357952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756012.832251:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756012.832323:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153357952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.832332:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1784756012.832400:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dc000 x1871452153357952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756012.832437:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153357952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756012.832598:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153358208:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.832605:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153358336:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.832670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832701:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784756012.832708:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153358080:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.832743:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832803:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153358592:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.832814:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756012.832832:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153358464:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.832844:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832891:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358208 00000100:00100000:1.0:1784756012.832896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756012.832900:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358208 00000100:00100000:2.0:1784756012.832944:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358336 00000100:00100000:2.0:1784756012.832947:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358336 00000100:00100000:2.0:1784756012.832970:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358592 00000100:00100000:2.0:1784756012.832974:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358592 00000100:00100000:2.0:1784756012.832999:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784756012.833006:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153358208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.833022:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784756012.833053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153358336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.833060:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153358208:12345-0@lo:400:kworker.0 Request processed in 51us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.833069:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784756012.833087:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784756012.833097:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153358592:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784756012.833266:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756012.833273:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756012.833737:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358464 00000100:00100000:0.0:1784756012.833747:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358464 00000100:00100000:0.0:1784756012.833807:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784756012.833816:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153358464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.833944:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153358592:12345-0@lo:400:kworker.0 Request processed in 845us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.833953:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784756012.833983:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358080 00000100:00100000:2.0:1784756012.833988:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358080 00000100:00100000:2.0:1784756012.834020:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784756012.834026:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153358080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.834080:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153358080:12345-0@lo:400:kworker.0 Request processed in 54us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.834087:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784756012.834135:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153358080:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.834148:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153358592:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.834158:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153358208:0@lo:400:kworker.0 00000100:00080000:3.0:1784756012.834310:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756012.835763:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153358336:12345-0@lo:400:kworker.0 Request processed in 2722us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756012.835776:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784756012.835874:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153358336:0@lo:400:kworker.0 00000100:00100000:0.0:1784756012.836770:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153358464:12345-0@lo:400:kworker.0 Request processed in 2951us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756012.836782:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1784756012.837563:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dfb80 x1871452153358464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756012.837579:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153358464:0@lo:400:kworker.0 00010000:00010000:1.0:1784756013.086937:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756013.862496:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756013.862874:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153358720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756013.862973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756013.869035:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358720 00000100:00100000:2.0:1784756013.869055:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358720 00000100:00100000:2.0:1784756013.869152:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784756013.869164:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153358720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756013.869220:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756013.869335:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153358720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (6362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756013.869344:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1784756013.869426:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80771880 x1871452153358720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756013.869452:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153358720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756014.114741:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756014.405437:0:10310:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 17:33:33 (1784756013) === 00010000:00010000:1.0:1784756015.136027:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756016.171845:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756017.052795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756017.052852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756017.052979:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547840 00000100:00100000:1.0:1784756017.052989:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547840 00000100:00100000:2.0:1784756017.052994:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136547968 00000100:00100000:2.0:1784756017.052997:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136547968 00000100:00100000:2.0:1784756017.053047:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 63 00000100:00100000:1.0:1784756017.053047:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 208 00000100:00100000:2.0:1784756017.053056:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136547968:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756017.053056:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136547840:12345-192.168.202.8@tcp:400:kworker.0 00000100:00080000:3.0:1784756017.053179:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756017.053243:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136547968:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756017.053251:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 63 00000100:00100000:1.0:1784756017.057876:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136547840:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 4808us (5080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.057952:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 208 00010000:00010000:1.0:1784756017.183865:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756017.951950:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153358848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756017.952127:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153359232:0@lo:400:kworker.0 00000100:00100000:2.0:1784756017.952194:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153359104:0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.953674:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153358976:0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.954625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756017.958115:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359232 00000100:00100000:1.0:1784756017.958129:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359232 00000100:00100000:1.0:1784756017.958255:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784756017.958265:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153359232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.958492:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1871452153359232:12345-0@lo:400:kworker.0 Request processed in 76us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.958500:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784756017.958553:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1871452153359232:0@lo:400:kworker.0 00000100:00080000:1.0:1784756017.958584:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756017.958927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756017.958971:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153359616:0@lo:400:kworker.0 00000100:00100000:2.0:1784756017.959003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756017.959142:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359104 00000100:00100000:1.0:1784756017.959147:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359104 00000100:00100000:1.0:1784756017.959192:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784756017.959198:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153359104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.959241:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153359104:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.959247:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784756017.959274:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153359104:0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.959299:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359616 00000100:00100000:1.0:1784756017.959303:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359616 00000100:00100000:1.0:1784756017.959335:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784756017.959353:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153359616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.959409:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153359616:12345-0@lo:400:kworker.0 Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.959415:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784756017.959430:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784756017.959448:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80855f80 x1871452153359616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756017.959458:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153359616:0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.962156:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756017.962254:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153359360:0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.962306:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756017.962615:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358848 00000100:00100000:1.0:1784756017.962623:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358848 00000100:00100000:1.0:1784756017.963105:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756017.963116:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153358848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756017.963174:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756017.963229:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153358848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.963237:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784756017.963501:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756017.963539:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153359488:0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.963570:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756017.963603:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359488 00000100:00100000:0.0:1784756017.963606:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359488 00010000:00080000:3.0:1784756017.963607:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605dca80 x1871452153358848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756017.963625:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153358848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756017.963747:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153358976 00000100:00100000:1.0:1784756017.963751:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153358976 00000100:00100000:1.0:1784756017.963827:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784756017.963835:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153358976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.963874:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153358976:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.963881:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784756017.963924:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784756017.963933:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153359488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.963964:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153359488:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756017.963984:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1784756017.964003:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756017.964021:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153358976:0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.964031:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153359488:0@lo:400:kworker.0 00000100:00100000:2.0:1784756017.966062:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359360 00000100:00100000:2.0:1784756017.966073:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359360 00000100:00100000:2.0:1784756017.966156:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784756017.966169:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153359360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756017.966263:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153359360:12345-0@lo:400:kworker.0 Request processed in 98us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756017.966271:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1784756017.966423:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756017.966704:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80771f80 x1871452153359360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756017.966721:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153359360:0@lo:400:kworker.0 00010000:00010000:3.0:1784756018.209371:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756018.975182:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153359744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756018.975466:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756018.975751:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359744 00000100:00100000:1.0:1784756018.975760:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359744 00000100:00100000:1.0:1784756018.975819:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756018.975829:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153359744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756018.975999:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756018.976058:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153359744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756018.976066:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1784756018.976152:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80855f80 x1871452153359744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756018.976301:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153359744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756019.235986:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756020.050134:0:10503:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1784756020.255905:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756021.281423:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756022.171456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756022.171585:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756022.171737:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548096 00000100:00100000:0.0:1784756022.171749:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548096 00000100:00100000:0.0:1784756022.171809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 210 00000100:00100000:0.0:1784756022.171820:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136548096:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756022.171915:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136548096:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756022.171923:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 210 00000100:00100000:1.0:1784756022.178118:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548224 00000100:00100000:1.0:1784756022.178135:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548224 00000100:00100000:0.0:1784756022.178376:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 67 00000100:00100000:0.0:1784756022.178392:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136548224:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756022.178815:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136548224:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 427us (7380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756022.178836:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 67 00000100:00080000:1.0:1784756022.179916:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756022.303779:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756023.073832:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153359872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756023.073926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756023.074010:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153359872 00000100:00100000:3.0:1784756023.074019:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153359872 00000100:00100000:3.0:1784756023.074083:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784756023.074093:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153359872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756023.074149:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756023.074203:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153359872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756023.074213:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1784756023.074236:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756023.074272:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42fbd500 x1871452153359872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756023.074311:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153359872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756023.074860:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153360000:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.074903:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756023.074929:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153360512:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.074953:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756023.074972:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756023.074977:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153360384:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075011:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756023.075037:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153360128:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756023.075077:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756023.075081:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153360256:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075102:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756023.075142:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360000 00000100:00100000:0.0:1784756023.075148:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360000 00000100:00100000:0.0:1784756023.075179:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784756023.075187:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153360000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075224:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153360000:12345-0@lo:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756023.075231:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784756023.075259:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360512 00000100:00100000:0.0:1784756023.075262:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360512 00000100:00100000:0.0:1784756023.075290:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360128 00000100:00100000:0.0:1784756023.075293:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360128 00000100:00100000:0.0:1784756023.075304:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360256 00000100:00100000:0.0:1784756023.075306:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360256 00000100:00100000:0.0:1784756023.075331:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784756023.075339:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153360512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075370:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153360512:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756023.075376:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784756023.075388:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756023.075393:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153360128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075737:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153360128:12345-0@lo:400:kworker.0 Request processed in 342us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756023.075751:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756023.075764:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784756023.075770:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153360256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075799:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153360256:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756023.075805:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784756023.075823:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360384 00000100:00100000:0.0:1784756023.075827:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360384 00000100:00100000:0.0:1784756023.075855:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784756023.075861:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153360384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075889:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153360384:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756023.075895:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1784756023.075935:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd74700 x1871452153360384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756023.075947:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153360384:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075956:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153360000:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075964:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153360512:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.075996:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153360256:0@lo:400:kworker.0 00000100:00100000:0.0:1784756023.076005:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153360128:0@lo:400:kworker.0 00000100:00080000:0.0:1784756023.076022:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756023.076025:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784756023.336289:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756024.094936:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153360640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756024.095015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756024.095267:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360640 00000100:00100000:2.0:1784756024.095275:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360640 00000100:00100000:2.0:1784756024.095339:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784756024.095347:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153360640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756024.095382:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756024.096575:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153360640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1222us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756024.096601:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1784756024.098678:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80856680 x1871452153360640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756024.098707:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153360640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784756024.350802:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756025.375791:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756026.402401:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756027.291145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756027.291207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756027.291334:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548480 00000100:00100000:1.0:1784756027.291334:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548352 00000100:00100000:2.0:1784756027.291344:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548480 00000100:00100000:1.0:1784756027.291344:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548352 00000100:00100000:2.0:1784756027.291404:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 71 00000100:00100000:1.0:1784756027.291404:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 212 00000100:00100000:2.0:1784756027.291414:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136548480:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756027.291414:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136548352:12345-192.168.202.8@tcp:400:kworker.0 00000100:00080000:3.0:1784756027.291478:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756027.291480:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2354:x1871452136548480:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756027.291486:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 71 00000100:00100000:1.0:1784756027.294942:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136548352:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 3516us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756027.294960:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 212 00010000:00010000:3.0:1784756027.424712:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756028.193078:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153360768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756028.193161:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756028.193284:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360768 00000100:00100000:1.0:1784756028.193293:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360768 00000100:00100000:1.0:1784756028.193360:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784756028.193440:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153360768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756028.193488:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784756028.193528:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756028.193546:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153360768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756028.193554:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1784756028.193563:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd75c00 x1871452153360768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756028.193580:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153360768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756028.197038:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153361152:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.197117:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756028.197193:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756028.197201:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153361280:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.197234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756028.197282:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361152 00000100:00100000:2.0:1784756028.197291:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361152 00000100:00100000:1.0:1784756028.197411:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153361024:0@lo:400:kworker.0 00000100:00100000:1.0:1784756028.197448:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756028.197472:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784756028.197490:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153360896:0@lo:400:kworker.0 00000100:00100000:1.0:1784756028.197528:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756028.197555:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153361408:0@lo:400:kworker.0 00000100:00100000:1.0:1784756028.197579:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756028.197831:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361024 00000100:00100000:2.0:1784756028.197836:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361024 00000100:00100000:2.0:1784756028.197851:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361408 00000100:00100000:2.0:1784756028.197853:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361408 00000100:00100000:2.0:1784756028.197869:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784756028.197877:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153361152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.197931:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153361152:12345-0@lo:400:kworker.0 Request processed in 55us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756028.197938:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784756028.197956:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784756028.197961:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153361024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198008:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153361024:12345-0@lo:400:kworker.0 Request processed in 46us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756028.198014:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784756028.198026:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784756028.198031:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153361408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198056:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153361408:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756028.198060:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784756028.198077:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361280 00000100:00100000:2.0:1784756028.198080:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361280 00000100:00100000:2.0:1784756028.198106:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784756028.198111:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153361280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198147:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153361280:12345-0@lo:400:kworker.0 Request processed in 36us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756028.198153:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1784756028.198195:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605df800 x1871452153361280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756028.198209:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153361280:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198219:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153361152:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198248:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153361408:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.198256:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153361024:0@lo:400:kworker.0 00000100:00080000:1.0:1784756028.198483:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784756028.198488:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756028.199743:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153360896 00000100:00100000:0.0:1784756028.199753:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153360896 00000100:00100000:0.0:1784756028.199818:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784756028.199828:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756028.199909:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153360896:12345-0@lo:400:kworker.0 Request processed in 83us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756028.199916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784756028.199958:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153360896:0@lo:400:kworker.0 00010000:00010000:0.0:1784756028.446823:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756029.214973:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756029.214998:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153361536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756029.215071:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.215287:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361536 00000100:00100000:1.0:1784756029.215296:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361536 00000100:00100000:1.0:1784756029.215403:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784756029.215413:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153361536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756029.215451:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756029.215512:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153361536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.215518:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1784756029.215595:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80855c00 x1871452153361536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.215611:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153361536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756029.498433:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756030.495809:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756031.523193:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756032.412346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756032.413725:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548608 00000100:00100000:1.0:1784756032.413741:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548608 00000100:00100000:1.0:1784756032.413799:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 214 00000100:00100000:1.0:1784756032.413809:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136548608:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756032.413884:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136548608:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 76us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756032.413892:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 214 00000100:00100000:2.0:1784756032.415667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756032.416835:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548736 00000100:00100000:0.0:1784756032.416848:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548736 00000100:00080000:1.0:1784756032.417033:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756032.417160:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 75 00000100:00100000:0.0:1784756032.417172:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136548736:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756032.417275:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136548736:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 106us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756032.417283:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 75 00010000:00010000:0.0:1784756032.546787:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756033.310914:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153361792:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311002:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311055:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153362304:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311081:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311109:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784756033.311114:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153361664:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311141:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311160:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153362176:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311180:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311205:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153361920:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311237:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311254:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756033.311259:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153362048:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.311312:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361792 00000100:00100000:0.0:1784756033.311320:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361792 00000100:00100000:0.0:1784756033.311379:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362176 00000100:00100000:0.0:1784756033.311382:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362176 00000100:00100000:0.0:1784756033.311404:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361920 00000100:00100000:0.0:1784756033.311407:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361920 00000100:00100000:0.0:1784756033.311424:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784756033.311431:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153361792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311485:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1871452153361792:12345-0@lo:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311492:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784756033.311508:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784756033.311514:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153362176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311539:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153362176:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311545:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784756033.311555:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784756033.311561:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153361920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311588:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153361920:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784756033.311612:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362304 00000100:00100000:0.0:1784756033.311616:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362304 00000100:00100000:0.0:1784756033.311679:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362048 00000100:00100000:0.0:1784756033.311683:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362048 00000100:00100000:0.0:1784756033.311705:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756033.311711:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153362304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311740:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153362304:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311754:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756033.311764:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756033.311769:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153362048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311796:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153362048:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311801:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756033.311818:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153361664 00000100:00100000:0.0:1784756033.311821:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153361664 00000100:00100000:0.0:1784756033.311845:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1784756033.311851:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153361664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.311876:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153361664:12345-0@lo:400:kworker.0 Request processed in 25us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.311881:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1784756033.311918:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756033.311922:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756033.311924:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756033.311966:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756033.311975:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153362432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756033.312002:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.312030:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362432 00000100:00100000:0.0:1784756033.312033:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362432 00000100:00100000:0.0:1784756033.312056:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756033.312062:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153362432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756033.312089:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756033.312123:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153362432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.312138:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784756033.312172:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c068380 x1871452153362432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756033.312189:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153362432:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784756033.312213:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd76d80 x1871452153362048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756033.312220:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153362048:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.312242:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153361920:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.312260:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153361664:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.312268:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153362176:0@lo:400:kworker.0 00000100:00100000:0.0:1784756033.312275:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1871452153361792:0@lo:400:kworker.0 00010000:00080000:0.0:1784756033.312283:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd76680 x1871452153362304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756033.312291:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153362304:0@lo:400:kworker.0 00010000:00010000:0.0:1784756033.572798:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756034.334851:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756034.334886:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153362560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756034.334963:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756034.336139:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362560 00000100:00100000:3.0:1784756034.336151:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362560 00000100:00100000:3.0:1784756034.336208:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784756034.336228:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153362560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756034.336279:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756034.336353:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153362560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756034.336361:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1784756034.336411:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c068380 x1871452153362560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756034.336431:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153362560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756034.591823:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756035.615315:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756036.642672:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756036.728097:0:11201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1784756037.532426:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756037.532511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756037.532605:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548992 00000100:00100000:0.0:1784756037.532615:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548992 00000100:00100000:0.0:1784756037.532717:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 79 00000100:00100000:0.0:1784756037.532726:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136548992:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756037.532820:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136548992:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756037.532837:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 79 00000100:00080000:2.0:1784756037.533101:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756037.533217:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136548864 00000100:00100000:1.0:1784756037.533222:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136548864 00000100:00100000:1.0:1784756037.533262:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 216 00000100:00100000:1.0:1784756037.533269:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136548864:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756037.533309:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136548864:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 40us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756037.533323:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 216 00010000:00010000:0.0:1784756037.663863:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756038.436202:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756038.436228:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153362688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756038.436303:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756038.436369:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362688 00000100:00100000:0.0:1784756038.436375:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362688 00000100:00080000:2.0:1784756038.436542:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756038.437350:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756038.437362:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153362688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756038.437693:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153363200:0@lo:400:kworker.0 00002000:00000024:0.0:1784756038.438139:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756038.439561:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153362688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2194us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756038.439573:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784756038.444253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756038.444320:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784756038.444332:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153362816:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.444377:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756038.444506:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363200 00000100:00100000:3.0:1784756038.444525:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363200 00000100:00100000:3.0:1784756038.444591:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784756038.444600:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153363200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756038.444670:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153363200:12345-0@lo:400:kworker.0 Request processed in 72us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756038.444677:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1784756038.444806:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756038.445212:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153363328:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.445246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784756038.445292:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf80856680 x1871452153363200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756038.445306:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153363200:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.445332:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153362944:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.445356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756038.445378:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756038.445384:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153363072:0@lo:400:kworker.0 00000100:00100000:3.0:1784756038.446333:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363328 00000100:00100000:3.0:1784756038.446343:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363328 00000100:00100000:3.0:1784756038.446395:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362944 00000100:00100000:3.0:1784756038.446461:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362944 00000100:00100000:3.0:1784756038.446490:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784756038.446499:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153363328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756038.446578:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153363328:12345-0@lo:400:kworker.0 Request processed in 79us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756038.446585:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784756038.446600:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784756038.446607:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153362944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756038.446635:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153362944:12345-0@lo:400:kworker.0 Request processed in 29us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756038.446656:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784756038.446695:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153363328:0@lo:400:kworker.0 00000100:00080000:2.0:1784756038.446813:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756038.447221:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784756038.450821:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c069c00 x1871452153362688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756038.450850:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153362688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756038.455150:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153362944:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.455206:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153362816 00000100:00100000:1.0:1784756038.455213:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153362816 00000100:00100000:1.0:1784756038.455281:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784756038.455291:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153362816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.455374:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153362816:12345-0@lo:400:kworker.0 Request processed in 84us (10996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756038.455526:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153362816:0@lo:400:kworker.0 00000100:00100000:1.0:1784756038.456288:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1784756038.456502:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363072 00000100:00100000:2.0:1784756038.456510:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363072 00000100:00080000:0.0:1784756038.456572:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756038.456577:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784756038.456588:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756038.456685:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153363072:12345-0@lo:400:kworker.0 Request processed in 100us (9464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756038.456691:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784756038.457135:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153363072:0@lo:400:kworker.0 00010000:00010000:0.0:1784756038.687741:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756039.454910:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756039.454937:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153363456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756039.455010:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756039.455139:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363456 00000100:00100000:0.0:1784756039.455148:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363456 00000100:00100000:0.0:1784756039.455212:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784756039.455223:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153363456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756039.455271:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756039.455329:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153363456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756039.455347:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784756039.455420:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c069c00 x1871452153363456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756039.455440:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153363456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756039.710939:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784756040.607040:0:11348:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffe0bfac0 20000000:00000080:0.0:1784756040.607063:0:11348:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fcf7c127800 uarg=0000000000000000 20000000:01000000:0.0:1784756040.607102:0:11348:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784756040.607108:0:11348:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784756040.607112:0:11348:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784756040.611313:0:11349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784756040.611535:0:11348:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784756040.617132:0:11348:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784756040.617176:0:11348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617197:0:11348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617206:0:11348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617213:0:11348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617218:0:11348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617225:0:11348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617332:0:11348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617349:0:11348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 18 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.617365:0:11348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363584:0@lo:104: 00000100:00100000:1.0:1784756040.617442:0:11348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756040.617556:0:11348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617564:0:11348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 18 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.617573:0:11348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363712:0@lo:104: 00000100:00100000:1.0:1784756040.617595:0:11348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756040.617835:0:11348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.617843:0:11348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 18 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.617851:0:11348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363840:0@lo:104: 00000100:00100000:1.0:1784756040.617872:0:11348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756040.618412:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363584 00000100:00100000:2.0:1784756040.618420:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363584 00000100:00100000:2.0:1784756040.618463:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363712 00000100:00100000:2.0:1784756040.618466:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363712 00000100:00100000:2.0:1784756040.618483:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756040.618491:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:11348:x1871452153363584:12345-0@lo:104: 00010000:00010000:2.0:1784756040.618503:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618563:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756040.618569:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+4:11348:x1871452153363584:12345-0@lo:104: Request processed in 79us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.618576:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756040.618593:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756040.618600:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:11348:x1871452153363712:12345-0@lo:104: 00010000:00010000:2.0:1784756040.618618:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618685:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784756040.618691:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:11348:x1871452153363712:12345-0@lo:104: Request processed in 92us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.618697:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1784756040.618725:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784756040.618732:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618740:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf82151000 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:2.0:1784756040.618744:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618753:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756040.618760:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756040.618772:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784756040.618804:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618811:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756040.618835:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618842:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf82151000/0x8f2fc1536a2c367b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3682 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618862:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756040.618865:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618871:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b8c0800 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:2.0:1784756040.618874:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618880:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756040.618886:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756040.618891:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784756040.618905:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618911:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756040.618927:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618933:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0800/0x8f2fc1536a2c366d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3674 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.618943:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756040.618944:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756040.618946:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756040.618954:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756040.618974:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153363968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756040.619026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756040.619073:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153364096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756040.619100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756040.619133:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363968 00000100:00100000:2.0:1784756040.619137:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363968 00010000:00010000:2.0:1784756040.619170:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 19 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756040.619190:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364096 00000100:00100000:2.0:1784756040.619194:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364096 00010000:00010000:2.0:1784756040.619207:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 20 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756040.619219:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756040.619226:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf449de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3316:x1871452153363968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756040.619236:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756040.619241:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 20 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.619251:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 20 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.619280:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756040.619309:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf449de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+20:3316:x1871452153363968:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.619315:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756040.619359:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756040.619366:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153364096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756040.619380:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756040.619385:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 19 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.619394:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 19 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.619404:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756040.619432:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153364096:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.619439:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756040.619475:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153364096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756040.619500:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153363968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784756040.620467:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756040.620605:0:11348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.620621:0:11348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 9 pid: 5790 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.620633:0:11348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153364224:192.168.202.8@tcp:104: 00000100:00100000:2.0:1784756040.620847:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153363840 00000100:00100000:2.0:1784756040.620854:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153363840 00000100:00100000:2.0:1784756040.620889:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784756040.620897:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:11348:x1871452153363840:12345-0@lo:104: 00010000:00010000:2.0:1784756040.620909:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.621083:0:11348:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf7b3ba240 going to sleep for 11 seconds 00010000:00010000:1.0:1784756040.621102:0:11348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf82150400/0x8f2fc1536a2c3682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c367b expref: 18 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.621115:0:11348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80770700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363584:0@lo:104: 00010000:00010000:1.0:1784756040.621125:0:11348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf7b8c1000/0x8f2fc1536a2c3674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c366d expref: 17 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756040.621146:0:11348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363712:0@lo:104: 00000100:00100000:1.0:1784756040.621171:0:11348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80855f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153363840:0@lo:104: 00010000:00010000:2.0:1784756040.621208:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756040.621214:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+3:11348:x1871452153363840:12345-0@lo:104: Request processed in 319us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.621221:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784756040.622097:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756040.622106:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756040.622115:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b8c1400 already unused, calling callback (ffffffffc1bb4c20) 10000000:00010000:0.0:1784756040.622119:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756040.622128:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756040.622134:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756040.622141:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1784756040.624348:0:11348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11348:1871452153364224:192.168.202.8@tcp:104: 00010000:00010000:1.0:1784756040.624386:0:11348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.626505:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.626521:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756040.626570:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.626577:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c1400/0x8f2fc1536a2c365f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f2fc1536a2c3666 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.626596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756040.626598:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756040.626601:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756040.626608:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756040.626628:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153364352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756040.626709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756040.627835:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364352 00000100:00100000:2.0:1784756040.627845:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364352 00010000:00010000:2.0:1784756040.627890:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756040.627932:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756040.627942:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:3314:x1871452153364352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756040.627956:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756040.627961:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.627973:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.627988:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf82150000/0x8f2fc1536a2c3666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f2fc1536a2c365f expref: 17 pid: 5789 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756040.628003:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756040.628198:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:3314:x1871452153364352:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.628206:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756040.629122:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153364352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756040.634491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756040.635551:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549120 00000100:00100000:3.0:1784756040.635562:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549120 00010000:00010000:3.0:1784756040.635604:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756040.635667:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28 00000100:00100000:3.0:1784756040.635678:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136549120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756040.635693:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756040.635700:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635714:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635732:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf7b8c1c00/0x8f2fc1536a2c3658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bff expref: 10 pid: 5790 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635748:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635756:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635771:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635778:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635784:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635803:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635809:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dba00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:3.0:1784756040.635813:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635819:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635838:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756040.635849:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756040.635870:0:11348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.635881:0:11348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756040.635889:0:11348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fcf7b3dba00/0x8f2fc1536a2c3689 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756040.635911:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:2356:x1871452136549120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 235us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756040.635920:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28 00010000:00010000:2.0:1784756040.734860:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756041.758438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756041.759758:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549248 00000100:00100000:1.0:1784756041.759777:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549248 00000100:00100000:1.0:1784756041.759841:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 218 00000100:00100000:1.0:1784756041.759852:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+9:5569:x1871452136549248:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756041.759871:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756041.759891:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b3db800/0x8f2fc1536a2c3690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c06 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756041.759924:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b3db800/0x8f2fc1536a2c3690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c06 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756041.759935:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b3db800/0x8f2fc1536a2c3690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c06 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756041.759951:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3db800, rc 0) 00010000:00010000:2.0:1784756041.762054:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756041.768911:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136549248:12345-192.168.202.8@tcp:101:ll_cfg_requeue.0 Request processed in 9043us (10474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756041.768925:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 218 00000100:00100000:0.0:1784756041.777474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756041.781949:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549376 00000100:00100000:1.0:1784756041.781966:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549376 00000100:00100000:1.0:1784756041.782036:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 219 00000100:00100000:1.0:1784756041.782047:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136549376:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756041.782395:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136549376:12345-192.168.202.8@tcp:501:ll_cfg_requeue.0 Request processed in 348us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756041.782406:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 219 00000100:00100000:0.0:1784756041.797385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756041.798387:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549504 00000100:00100000:2.0:1784756041.798403:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549504 00000100:00100000:2.0:1784756041.798698:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 220 00000100:00100000:2.0:1784756041.798713:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136549504:12345-192.168.202.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756041.799355:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:5569:x1871452136549504:12345-192.168.202.8@tcp:503:ll_cfg_requeue.0 Request processed in 644us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756041.799367:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 220 10000000:01000000:0.0:1784756042.014817:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756042.014855:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fce44a76800 from 7 10000000:01000000:0.0:1784756042.014863:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756042.014933:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.014960:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.014975:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.015011:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.015116:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.015189:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756042.015981:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364480 00000100:00100000:1.0:1784756042.016012:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364480 00000100:00100000:1.0:1784756042.016107:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784756042.016120:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+16:5793:x1871452153364480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756042.016141:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756042.016174:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b3da800/0x8f2fc1536a2c369e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c3697 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.016222:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b3da800/0x8f2fc1536a2c369e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3697 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.016235:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b3da800/0x8f2fc1536a2c369e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c3697 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.016246:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3da800, rc 0) 00000100:00100000:1.0:1784756042.016359:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.016368:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784756042.016512:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756042.016537:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c369e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.016549:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c369e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.016714:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.016757:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.016793:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756042.016865:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364608 00000100:00100000:2.0:1784756042.016871:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364608 00000100:00100000:2.0:1784756042.016912:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784756042.016920:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756042.017304:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756042.017312:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784756042.017433:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756042.017556:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756042.017614:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756042.017631:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf667d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756042.017790:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364736 00000100:00100000:1.0:1784756042.017797:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364736 00000100:00100000:1.0:1784756042.017835:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784756042.017843:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756042.018181:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.018189:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784756042.018223:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756042.019744:0:11370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784756042.019862:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784756042.019891:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756042.019906:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c369e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.019921:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0e00/0x8f2fc1536a2c3697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c369e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756042.019966:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756042.019970:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf463c1000 from 7 10000000:01000000:0.0:1784756042.019973:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756042.020017:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.020026:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.020039:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.020067:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.020156:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.020211:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756042.020234:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364864 00000100:00100000:1.0:1784756042.020255:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364864 00000100:00100000:1.0:1784756042.020315:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784756042.020327:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+17:5793:x1871452153364864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756042.020344:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756042.020360:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf7b3db400/0x8f2fc1536a2c36ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c36a5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.020388:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf7b3db400/0x8f2fc1536a2c36ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c36a5 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.020399:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf7b3db400/0x8f2fc1536a2c36ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c36a5 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.020410:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3db400, rc 0) 00000100:00100000:1.0:1784756042.020458:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153364864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.020465:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784756042.020914:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756042.020935:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.021394:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c36ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.021487:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.021538:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.021588:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756042.021817:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153364992 00000100:00100000:1.0:1784756042.021824:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153364992 00000100:00100000:1.0:1784756042.021911:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784756042.021922:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153364992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756042.022288:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153364992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.022298:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784756042.022855:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153364992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.022910:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.022977:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756042.025793:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365120 00000100:00100000:2.0:1784756042.025813:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365120 00000100:00100000:3.0:1784756042.028891:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fce44a3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784756042.029011:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784756042.029025:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153365120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756042.029967:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153365120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 940us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756042.029979:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784756042.030085:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756042.032807:0:11371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784756042.034352:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784756042.034394:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756042.034410:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.034428:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0a00/0x8f2fc1536a2c36a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756042.034444:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756042.034448:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8fcf4549c800 from 7 10000000:01000000:0.0:1784756042.034451:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756042.034523:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.034532:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.034545:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.034578:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.034723:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.034777:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756042.035270:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365248 00000100:00100000:3.0:1784756042.035280:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365248 00000100:00100000:3.0:1784756042.035350:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784756042.035362:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+18:5793:x1871452153365248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756042.035380:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756042.035396:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c36ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f2fc1536a2c36b3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756042.035429:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c36ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f2fc1536a2c36b3 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756042.035441:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fcf74010800/0x8f2fc1536a2c36ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f2fc1536a2c36b3 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756042.035450:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74010800, rc 0) 00000100:00100000:3.0:1784756042.035631:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf46283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153365248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756042.035673:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784756042.036252:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756042.036273:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ba expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756042.036307:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f2fc1536a2c36ba expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756042.036387:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.036432:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.036593:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756042.036688:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365376 00000100:00100000:3.0:1784756042.036694:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365376 00000100:00100000:3.0:1784756042.036740:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784756042.036751:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153365376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756042.037076:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153365376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756042.037091:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784756042.037598:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.037738:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756042.037802:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.037841:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff8fcf42f0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756042.037912:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365504 00000100:00100000:1.0:1784756042.037919:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365504 00000100:00100000:1.0:1784756042.037970:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784756042.037979:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153365504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756042.038206:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:5793:x1871452153365504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.038214:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784756042.039704:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:5793:1871452153365504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756042.042174:0:11372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784756042.042676:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784756042.042713:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756042.042731:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ba expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756042.042748:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.108@tcp lock: ffff8fcf7b8c0600/0x8f2fc1536a2c36b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f2fc1536a2c36ba expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756042.652599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756042.653326:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756042.654221:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549632 00000100:00100000:2.0:1784756042.654247:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549632 00000100:00100000:2.0:1784756042.654348:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 230 00000100:00100000:2.0:1784756042.654360:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136549632:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756042.654486:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2357:x1871452136549632:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 127us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756042.654508:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 230 00000100:00100000:1.0:1784756042.661541:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549760 00000100:00100000:1.0:1784756042.661565:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549760 00000100:00100000:1.0:1784756042.661747:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 83 00000100:00100000:1.0:1784756042.661762:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136549760:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1784756042.661890:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136549760:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 131us (9303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.661911:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 83 00000100:00080000:3.0:1784756042.667539:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784756042.783200:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756043.550827:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756043.550861:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153365632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756043.550965:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.551052:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365632 00000100:00100000:0.0:1784756043.551062:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365632 00000100:00100000:0.0:1784756043.551146:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784756043.551155:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153365632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756043.551210:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756043.551267:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153365632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.551274:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1784756043.551299:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756043.551341:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7c069c00 x1871452153365632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756043.551379:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153365632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756043.551800:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153365888:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.551841:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.551865:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756043.551871:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153366016:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.551914:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756043.552011:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153365760:0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552049:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756043.552075:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153366272:0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552097:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756043.552115:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756043.552121:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153366144:0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552157:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756043.552186:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365888 00000100:00100000:1.0:1784756043.552192:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365888 00000100:00100000:1.0:1784756043.552231:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366016 00000100:00100000:1.0:1784756043.552234:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366016 00000100:00100000:1.0:1784756043.552256:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366272 00000100:00100000:1.0:1784756043.552259:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366272 00000100:00100000:1.0:1784756043.552277:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784756043.552285:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7c069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153365888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552326:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7c069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1871452153365888:12345-0@lo:400:kworker.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756043.552333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784756043.552349:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784756043.552355:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153366016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552394:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153366016:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756043.552401:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784756043.552414:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784756043.552421:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153366272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756043.552459:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1871452153366272:12345-0@lo:400:kworker.0 Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756043.552466:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784756043.552499:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1871452153366272:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.552623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153365760 00000100:00100000:0.0:1784756043.552628:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153365760 00000100:00100000:0.0:1784756043.552697:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784756043.552705:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153365760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.552744:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3317:x1871452153365760:12345-0@lo:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.552751:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784756043.552785:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366144 00000100:00100000:0.0:1784756043.552789:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366144 00000100:00100000:0.0:1784756043.552818:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756043.552826:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.552858:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153366144:12345-0@lo:400:kworker.0 Request processed in 33us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.552865:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1784756043.552883:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756043.552888:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756043.552905:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153366016:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.552915:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1871452153365888:0@lo:400:kworker.0 00010000:00080000:0.0:1784756043.553082:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd76a00 x1871452153366144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756043.553095:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153366144:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.553104:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3317:1871452153365760:0@lo:400:kworker.0 00010000:00010000:2.0:1784756043.807390:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756044.587168:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fce456a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153366400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756044.587241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756044.587314:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366400 00000100:00100000:0.0:1784756044.587322:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366400 00000100:00100000:0.0:1784756044.587366:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756044.587374:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153366400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756044.587412:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756044.587455:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153366400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.587462:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784756044.587503:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fce456a5500 x1871452153366400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756044.587522:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fce456a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153366400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756044.830808:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756045.521189:0:11546:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg208-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784756045.860762:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756046.879886:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756047.789750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756047.789831:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136549888 00000100:00100000:3.0:1784756047.789841:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136549888 00000100:00100000:3.0:1784756047.789902:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 232 00000100:00100000:3.0:1784756047.789911:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136549888:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784756047.790027:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2356:x1871452136549888:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756047.790035:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 232 00000100:00100000:3.0:1784756047.795410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756047.795450:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550016 00000100:00100000:3.0:1784756047.795460:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550016 00000100:00100000:3.0:1784756047.795530:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 87 00000100:00100000:3.0:1784756047.795541:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136550016:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1784756047.795623:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136550016:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756047.795631:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 87 00000100:00080000:3.0:1784756047.795671:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756047.902798:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756048.671443:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153366528:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671514:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.671558:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153367040:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671599:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.671626:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756048.671631:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153366912:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671695:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153366656:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671721:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.671740:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153367168:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671764:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.671781:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756048.671786:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153366784:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671803:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.671841:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366528 00000100:00100000:1.0:1784756048.671848:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366528 00000100:00100000:1.0:1784756048.671891:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784756048.671899:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153366528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.671941:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3315:x1871452153366528:12345-0@lo:400:kworker.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.671957:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784756048.671990:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367040 00000100:00100000:1.0:1784756048.671993:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367040 00000100:00100000:1.0:1784756048.672020:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366656 00000100:00100000:1.0:1784756048.672023:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366656 00000100:00100000:1.0:1784756048.672032:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366784 00000100:00100000:1.0:1784756048.672034:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366784 00000100:00100000:1.0:1784756048.672047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784756048.672053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153367040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672081:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1871452153367040:12345-0@lo:400:kworker.0 Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.672098:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784756048.672109:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784756048.672114:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153366656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672139:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153366656:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.672145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784756048.672154:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784756048.672159:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153366784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672177:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1871452153366784:12345-0@lo:400:kworker.0 Request processed in 19us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.672183:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784756048.672201:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367168 00000100:00100000:1.0:1784756048.672204:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367168 00000100:00100000:1.0:1784756048.672227:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784756048.672232:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153367168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672263:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153367168:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.672268:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1784756048.672288:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784756048.672292:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756048.672321:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1871452153366784:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672329:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153366656:0@lo:400:kworker.0 00010000:00080000:1.0:1784756048.672339:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd76d80 x1871452153367168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756048.672349:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153367168:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672382:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.672400:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3315:1871452153366528:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672409:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1871452153367040:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672424:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153366912 00000100:00100000:1.0:1784756048.672427:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153366912 00000100:00100000:1.0:1784756048.672449:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784756048.672454:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153366912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.672485:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153366912:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.672491:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1784756048.672506:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756048.672520:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd77100 x1871452153366912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756048.672528:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153366912:0@lo:400:kworker.0 00000100:00100000:1.0:1784756048.673254:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf42fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153367296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756048.673286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756048.673689:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367296 00000100:00100000:0.0:1784756048.673703:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367296 00000100:00100000:0.0:1784756048.673736:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784756048.673743:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153367296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756048.673787:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756048.673838:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153367296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756048.673844:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784756048.673886:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf42fbd180 x1871452153367296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756048.673916:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf42fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153367296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756048.928360:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756049.030236:0:11646:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 17:34:08 (1784756048) === 00000100:00100000:3.0:1784756049.115061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.116170:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550144 00000100:00100000:1.0:1784756049.116181:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550144 00000100:00100000:1.0:1784756049.116247:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 10 00000100:00100000:1.0:1784756049.116257:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf42fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550144:12345-192.168.202.8@tcp:101:bash.0 00010000:00010000:1.0:1784756049.116278:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756049.116341:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db000/0x8f2fc1536a2c36c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c0d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116414:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116428:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116440:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116454:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116461:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116467:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784756049.116720:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756049.116973:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116992:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.116999:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117005:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dba00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.117010:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117018:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117030:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:1.0:1784756049.117033:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.117037:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117044:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117055:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117062:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117068:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117074:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da200 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.117093:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117099:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117106:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff8fcf50616300) 00010000:00010000:1.0:1784756049.117109:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.117112:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117118:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117153:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db000/0x8f2fc1536a2c36c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c0d expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117162:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:1.0:1784756049.117164:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784756049.117168:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db000/0x8f2fc1536a2c36c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c0d expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.117176:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3db000, rc 0) 00000100:00100000:1.0:1784756049.117287:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf42fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550144:12345-192.168.202.8@tcp:101:bash.0 Request processed in 1031us (2235us total) trans 0 rc 301/301 00000100:00100000:1.0:1784756049.117294:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 10 00000100:00100000:3.0:1784756049.135856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.136113:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550272 00000100:00100000:2.0:1784756049.136124:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550272 00000100:00100000:2.0:1784756049.136181:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 11 00000100:00100000:2.0:1784756049.136191:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550272:12345-192.168.202.8@tcp:101:bash.0 00010000:00010000:2.0:1784756049.136213:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.136237:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c36d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c14 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136305:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136319:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136332:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136368:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136375:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136381:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.136980:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137000:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137006:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137013:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271800 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.137018:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137024:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137037:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:2.0:1784756049.137039:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.137044:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137050:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c36dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137060:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137066:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137072:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137077:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.137100:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137106:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137115:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff8fcf429d8000) 00010000:00010000:2.0:1784756049.137118:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.137121:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137127:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c36e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137163:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c36d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c14 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137173:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:2.0:1784756049.137175:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784756049.137179:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c36d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c14 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.137187:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271000, rc 0) 00000100:00100000:2.0:1784756049.137302:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550272:12345-192.168.202.8@tcp:101:bash.0 Request processed in 1111us (1458us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756049.137310:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 11 00000100:00100000:2.0:1784756049.144038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.144115:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550400 00000100:00100000:3.0:1784756049.144125:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550400 00000100:00100000:3.0:1784756049.144196:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1 00000100:00100000:3.0:1784756049.144208:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550400:12345-192.168.202.8@tcp:37:bash.0 00000100:00100000:2.0:1784756049.148090:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:7609:x1871452136550400:12345-192.168.202.8@tcp:37:bash.0 Request processed in 3861us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.148111:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1 00000100:00100000:3.0:1784756049.183334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.183539:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550528 00000100:00100000:1.0:1784756049.183549:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550528 00000100:00100000:1.0:1784756049.183618:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:1.0:1784756049.183629:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf60437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10401:x1871452136550528:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:1.0:1784756049.183688:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756049.183710:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c1b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183779:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183795:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183807:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183862:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183870:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.183878:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184132:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184141:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184147:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184152:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dba00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.184161:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184168:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184360:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:1.0:1784756049.184364:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.184368:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184375:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dba00/0x8f2fc1536a2c36f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184387:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184393:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184399:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184404:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3db200 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.184407:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184412:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184418:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff8fcf50616300) 00010000:00010000:1.0:1784756049.184420:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.184428:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184434:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db200/0x8f2fc1536a2c36f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184465:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c1b expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184474:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:1.0:1784756049.184477:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.184480:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da200/0x8f2fc1536a2c36eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c1b expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.184488:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3da200, rc 0) 00000100:00100000:1.0:1784756049.184556:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf60437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10401:x1871452136550528:12345-192.168.202.8@tcp:101:rm.0 Request processed in 929us (1230us total) trans 0 rc 301/301 00000100:00100000:1.0:1784756049.184563:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:1.0:1784756049.252797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.253076:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550784 00000100:00100000:3.0:1784756049.253097:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550784 00000100:00100000:3.0:1784756049.253155:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 0 00000100:00100000:3.0:1784756049.253166:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10404:x1871452136550784:12345-192.168.202.8@tcp:700:mkdir.0 00000100:00100000:3.0:1784756049.253260:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10404:x1871452136550784:12345-192.168.202.8@tcp:700:mkdir.0 Request processed in 96us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756049.253269:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 0 00000100:00100000:2.0:1784756049.273305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.273354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.273514:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136550656 00000100:00100000:1.0:1784756049.273525:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136550656 00000100:00100000:2.0:1784756049.273655:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551040 00000100:00100000:2.0:1784756049.273660:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551040 00000100:00100000:3.0:1784756049.273662:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13 00000100:00100000:3.0:1784756049.273673:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2356:x1871452136550656:12345-192.168.202.8@tcp:41:mkdir.0 00000100:00100000:2.0:1784756049.273692:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14 00000100:00100000:2.0:1784756049.273699:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10404:x1871452136551040:12345-192.168.202.8@tcp:36:mkdir.0 00010000:00010000:2.0:1784756049.273747:0:8321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756049.273775:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf82150a00/0x8f2fc1536a2c35d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2bea expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.273795:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616d00) 00010000:00010000:2.0:1784756049.273807:0:8321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000024:3.0:1784756049.273991:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784756049.274077:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136550656:12345-192.168.202.8@tcp:41:mkdir.0 Request processed in 406us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756049.274095:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13 00010000:00010000:2.0:1784756049.274099:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.274113:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.274123:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.274182:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.274190:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.274197:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.275429:0:8321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784756049.275447:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275456:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275462:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275468:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.275473:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275480:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275492:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf429d8000) 00010000:00010000:2.0:1784756049.275495:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.275498:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.275503:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3700 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756049.275518:0:8321:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0d6ebcf reply state 00000000b407dcd7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756049.275527:0:8321:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784756049.275604:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10404:x1871452136551040:12345-192.168.202.8@tcp:36:mkdir.0 Request processed in 1903us (2247us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784756049.275612:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14 00010000:00010000:3.0:1784756049.283985:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284020:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284027:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284033:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271800 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.284038:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284046:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284063:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fcf429d8a00) 00010000:00010000:3.0:1784756049.284067:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.284072:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.284089:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3707 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.309336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.309753:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551168 00000100:00100000:2.0:1784756049.309780:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551168 00000100:00100000:2.0:1784756049.309851:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:2.0:1784756049.309862:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10405:x1871452136551168:12345-192.168.202.8@tcp:101:chmod.0 00010000:00010000:2.0:1784756049.309885:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.309911:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c370e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c22 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.309980:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.309995:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.310006:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.310068:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756049.310073:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756049.310123:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.310149:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c370e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c22 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.310170:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c22 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.310179:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf429d8000) 00010000:00010000:2.0:1784756049.310182:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756049.310186:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270e00, rc 0) 00000100:00100000:2.0:1784756049.310260:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10405:x1871452136551168:12345-192.168.202.8@tcp:101:chmod.0 Request processed in 399us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.310267:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:2.0:1784756049.314789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.314876:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551424 00000100:00100000:1.0:1784756049.314886:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551424 00000100:00100000:1.0:1784756049.314952:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 16 00000100:00100000:1.0:1784756049.314962:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10405:x1871452136551424:12345-192.168.202.8@tcp:36:chmod.0 00010000:00010000:1.0:1784756049.315024:0:8321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756049.315058:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c3715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c22 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.315110:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf429d8000) 00010000:00010000:1.0:1784756049.315124:0:8321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756049.315153:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.315166:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.315177:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756049.315492:0:8321:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000141dbf8f reply state 00000000bff1117b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.315502:0:8321:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784756049.315516:0:8321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784756049.316885:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:10405:x1871452136551424:12345-192.168.202.8@tcp:36:chmod.0 Request processed in 1916us (2099us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784756049.316896:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 16 00010000:00010000:3.0:1784756049.322947:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.322966:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.322973:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.322980:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dae00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.322999:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.323006:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.323023:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616300) 00010000:00010000:3.0:1784756049.323025:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784756049.323029:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.323036:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c371c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756049.346796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.346968:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551552 00000100:00100000:1.0:1784756049.346978:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551552 00000100:00100000:1.0:1784756049.347138:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 17 00000100:00100000:1.0:1784756049.347151:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10406:x1871452136551552:12345-192.168.202.8@tcp:101:chown.0 00010000:00010000:1.0:1784756049.347174:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756049.347207:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c29 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347272:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347286:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347313:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756049.347368:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784756049.347372:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756049.347420:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347445:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c29 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347463:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c29 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.347472:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616600) 00010000:00010000:1.0:1784756049.347476:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784756049.347480:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3dbe00, rc 0) 00000100:00100000:1.0:1784756049.347539:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:10406:x1871452136551552:12345-192.168.202.8@tcp:101:chown.0 Request processed in 391us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.347546:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 17 00000100:00100000:0.0:1784756049.350274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.350401:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551680 00000100:00100000:2.0:1784756049.350420:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551680 00000100:00100000:2.0:1784756049.350473:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 18 00000100:00100000:2.0:1784756049.350483:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:10406:x1871452136551680:12345-192.168.202.8@tcp:101:chown.0 00010000:00010000:2.0:1784756049.350504:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.350524:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c3731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c30 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350587:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350600:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350611:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350626:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350633:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350669:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350789:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350798:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.350805:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.351055:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784756049.351060:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756049.351097:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351109:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351115:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351121:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351127:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271e00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.351131:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351139:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351152:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616600) 00010000:00010000:2.0:1784756049.351162:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.351167:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351173:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351198:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351203:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351209:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351213:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270400 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.351216:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351222:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351228:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fcf429d8f00) 00010000:00010000:2.0:1784756049.351231:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.351233:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351239:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c373f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351269:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c3731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c30 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351294:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c30 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.351302:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8c00) 00010000:00010000:2.0:1784756049.351305:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756049.351307:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270000, rc 0) 00000100:00100000:2.0:1784756049.351370:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:10406:x1871452136551680:12345-192.168.202.8@tcp:101:chown.0 Request processed in 888us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.351378:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 18 00000100:00100000:2.0:1784756049.354877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.355012:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136551936 00000100:00100000:3.0:1784756049.355023:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136551936 00000100:00100000:3.0:1784756049.355089:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 19 00000100:00100000:3.0:1784756049.355100:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:10406:x1871452136551936:12345-192.168.202.8@tcp:36:chown.0 00010000:00010000:3.0:1784756049.355156:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756049.355191:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c30 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.355210:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8c00) 00010000:00010000:3.0:1784756049.355220:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756049.355244:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.355256:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.355265:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784756049.390359:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1784756049.390378:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1784756049.390468:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6c14ac5 reply state 00000000a551b1a2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756049.390483:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784756049.390625:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1784756049.390852:0:5796:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784756049.390871:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10406:x1871452136551936:12345-192.168.202.8@tcp:36:chown.0 Request processed in 35769us (35999us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784756049.390880:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 19 00010000:00010000:3.0:1784756049.390912:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390921:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390928:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390935:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74011a00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.390940:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390948:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390962:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf6de9e300) 00010000:00010000:3.0:1784756049.390965:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784756049.390970:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.390987:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c374d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756049.407348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756049.407588:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552064 00000100:00100000:0.0:1784756049.407599:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552064 00000100:00100000:0.0:1784756049.407791:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 20 00000100:00100000:0.0:1784756049.407801:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10407:x1871452136552064:12345-192.168.202.8@tcp:101:touch.500 00010000:00010000:0.0:1784756049.407893:0:8321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756049.407920:0:8321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c1200/0x8f2fc1536a2c3754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c37 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784756049.422921:0:8321:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 14948us 00010000:00010000:2.0:1784756049.454557:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.454580:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.454592:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.454608:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.454614:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.454621:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455138:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455148:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455155:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.455440:0:8321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756049.455445:0:8321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756049.455540:0:8321:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455555:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455562:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455568:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455574:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270a00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.455578:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455585:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455598:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616600) 00010000:00010000:2.0:1784756049.455607:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.455613:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455620:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c375b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455633:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455666:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455672:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455678:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270400 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.455680:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455686:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455694:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fcf429d8500) 00010000:00010000:2.0:1784756049.455697:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.455699:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455705:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c3762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455744:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c1200/0x8f2fc1536a2c3754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c37 expref: 8 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455771:0:8321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c37 expref: 7 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.455779:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:2.0:1784756049.455782:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784756049.455784:0:8321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271e00, rc 0) 00000100:00100000:2.0:1784756049.455966:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10407:x1871452136552064:12345-192.168.202.8@tcp:101:touch.500 Request processed in 48165us (48626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.455975:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 20 00000100:00100000:0.0:1784756049.459297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.459497:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552320 00000100:00100000:2.0:1784756049.459508:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552320 00000100:00100000:2.0:1784756049.459600:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 21 00000100:00100000:2.0:1784756049.459612:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:10407:x1871452136552320:12345-192.168.202.8@tcp:101:touch.500 00010000:00010000:2.0:1784756049.459669:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.459692:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3770 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c3e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460166:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460245:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460259:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460276:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460291:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.460298:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784756049.462500:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1784756049.464343:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.464369:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.464382:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.464492:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.464499:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.464506:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465113:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756049.465121:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465130:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465162:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:2.0:1784756049.465165:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756049.465170:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465244:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c3777 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756049.465259:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000472d69bf reply state 00000000d6db9560 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756049.465268:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784756049.465309:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c3770 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c3e expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465324:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c3e expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.465332:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf429d8e00) 00010000:00010000:2.0:1784756049.465334:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784756049.465336:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271800, rc 0) 00000100:00100000:2.0:1784756049.465527:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:10407:x1871452136552320:12345-192.168.202.8@tcp:101:touch.500 Request processed in 5917us (6237us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756049.465536:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 21 00000100:00100000:1.0:1784756049.470299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.470375:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552576 00000100:00100000:2.0:1784756049.470385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552576 00000100:00100000:2.0:1784756049.470460:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 22 00000100:00100000:2.0:1784756049.470470:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:10407:x1871452136552576:12345-192.168.202.8@tcp:36:touch.500 00010000:00010000:2.0:1784756049.470542:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756049.470570:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271800/0x8f2fc1536a2c3785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c3e expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.470590:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf429d8e00) 00010000:00010000:2.0:1784756049.470601:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756049.470667:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.470682:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.470693:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756049.470830:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002057c747 reply state 000000005b2f9d9f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756049.470840:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784756049.470931:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:10407:x1871452136552576:12345-192.168.202.8@tcp:36:touch.500 Request processed in 462us (641us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784756049.470938:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 22 00010000:00010000:3.0:1784756049.474244:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474263:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474271:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474278:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270e00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.474283:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474290:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474306:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8fcf429d8600) 00010000:00010000:3.0:1784756049.474309:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.474313:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474320:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270e00/0x8f2fc1536a2c377e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.474628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1784756049.474760:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474770:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474790:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474795:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271000 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.474797:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474803:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474811:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf429d8900) 00010000:00010000:3.0:1784756049.474814:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.474817:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.474831:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c3793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756049.474953:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552704 00000100:00100000:0.0:1784756049.474963:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552704 00000100:00100000:0.0:1784756049.475024:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00100000:0.0:1784756049.475033:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:10407:x1871452136552704:12345-192.168.202.8@tcp:101:touch.500 00010000:00010000:0.0:1784756049.475066:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756049.475096:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c0400/0x8f2fc1536a2c379a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c45 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756049.475157:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c0400/0x8f2fc1536a2c379a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c45 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756049.475174:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c0400/0x8f2fc1536a2c379a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c45 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756049.475191:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf47b5a800) 00010000:00010000:0.0:1784756049.475193:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784756049.475195:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c0400, rc 0) 00000100:00100000:0.0:1784756049.475252:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:10407:x1871452136552704:12345-192.168.202.8@tcp:101:touch.500 Request processed in 219us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756049.475259:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 23 00000100:00100000:2.0:1784756049.478561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.478693:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552832 00000100:00100000:1.0:1784756049.478705:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552832 00000100:00100000:1.0:1784756049.478759:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:1.0:1784756049.478769:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1871452136552832:12345-192.168.202.8@tcp:8:touch.500 00010000:00080000:1.0:1784756049.478807:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417@192.168.202.8@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:1.0:1784756049.478865:0:6590:0:(genops.c:1406:class_connect()) connect: client 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417, cookie 0x8f2fc1536a2c37a1 00002000:00100000:1.0:1784756049.478877:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417/ffff8fcf7c6e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784756049.478904:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784756049.479153:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784756049.479194:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8fcf7c6e5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784756049.479256:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2353:x1871452136552832:12345-192.168.202.8@tcp:8:touch.500 Request processed in 488us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.479263:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12 00000100:00100000:1.0:1784756049.482693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756049.482855:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136552960 00000100:00100000:0.0:1784756049.482865:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136552960 00000100:00100000:0.0:1784756049.482927:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13 00000100:00100000:0.0:1784756049.482938:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:0:x1871452136552960:12345-192.168.202.8@tcp:2:touch.500 00000100:00080000:3.0:1784756049.483257:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756049.510021:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:0:x1871452136552960:12345-192.168.202.8@tcp:2:touch.500 Request processed in 27073us (27329us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784756049.510033:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13 00000001:00080000:3.0:1784756049.511277:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1784756049.511293:0:6615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000100:00100000:2.0:1784756049.515748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.515842:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136553216 00000100:00100000:3.0:1784756049.515852:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136553216 00000100:00100000:3.0:1784756049.515919:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2 00000100:00100000:3.0:1784756049.515930:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:10407:x1871452136553216:12345-192.168.202.8@tcp:35:touch.500 00000100:00100000:3.0:1784756049.516340:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:10407:x1871452136553216:12345-192.168.202.8@tcp:35:touch.500 Request processed in 410us (602us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784756049.516349:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2 00000100:00100000:0.0:1784756049.536998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.537111:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136553344 00000100:00100000:2.0:1784756049.537122:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136553344 00000100:00100000:2.0:1784756049.537194:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 24 00000100:00100000:2.0:1784756049.537205:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:10408:x1871452136553344:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:2.0:1784756049.537231:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.537268:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c37a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c4c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537333:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537347:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537358:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.537431:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756049.537435:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756049.537474:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537500:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c37a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c4c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537516:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c4c expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.537524:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:2.0:1784756049.537527:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756049.537530:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271600, rc 0) 00000100:00100000:2.0:1784756049.537590:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+12:10408:x1871452136553344:12345-192.168.202.8@tcp:101:rm.0 Request processed in 388us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.537597:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 24 00000100:00100000:1.0:1784756049.541129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756049.541281:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136553600 00000100:00100000:0.0:1784756049.541292:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136553600 00000100:00100000:0.0:1784756049.541351:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 25 00000100:00100000:0.0:1784756049.541375:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+12:10408:x1871452136553600:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:0.0:1784756049.541397:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756049.541428:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c1000/0x8f2fc1536a2c37b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c53 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756049.541554:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784756049.541753:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c1000/0x8f2fc1536a2c37b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c53 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756049.541769:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616600) 00010000:00010000:0.0:1784756049.541772:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756049.541777:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c1000/0x8f2fc1536a2c37b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c53 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756049.541792:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c1000, rc 0) 00000100:00100000:1.0:1784756049.542946:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:10408:x1871452136553600:12345-192.168.202.8@tcp:101:rm.0 Request processed in 1565us (1819us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1784756049.542956:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 25 00000100:00100000:3.0:1784756049.551862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.552022:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136553728 00000100:00100000:2.0:1784756049.552040:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136553728 00000100:00100000:2.0:1784756049.552104:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:2.0:1784756049.552114:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:10408:x1871452136553728:12345-192.168.202.8@tcp:37:rm.0 00000100:00100000:2.0:1784756049.557350:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:10408:x1871452136553728:12345-192.168.202.8@tcp:37:rm.0 Request processed in 5226us (5486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.557365:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:1.0:1784756049.561576:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.561674:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136553984 00000100:00100000:3.0:1784756049.561687:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136553984 00000100:00100000:3.0:1784756049.561763:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 4 00000100:00100000:3.0:1784756049.561777:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf4e14d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:10408:x1871452136553984:12345-192.168.202.8@tcp:35:rm.0 00000100:00100000:3.0:1784756049.562105:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf4e14d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+14:10408:x1871452136553984:12345-192.168.202.8@tcp:35:rm.0 Request processed in 331us (540us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784756049.562114:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 4 00000100:00100000:3.0:1784756049.565765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756049.565861:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136554240 00000100:00100000:2.0:1784756049.565873:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136554240 00000100:00100000:2.0:1784756049.565936:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 26 00000100:00100000:2.0:1784756049.565947:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+14:10408:x1871452136554240:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:2.0:1784756049.565973:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756049.565994:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c37c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c5a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.566135:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c37cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.566150:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c37cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.566162:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c37cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756049.566173:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784756049.566555:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270000/0x8f2fc1536a2c37c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c5a expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.566576:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c37cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c5a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.566595:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:2.0:1784756049.566598:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784756049.566601:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270400, rc 0) 00000100:00100000:2.0:1784756049.566811:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136554240:12345-192.168.202.8@tcp:101:rm.0 Request processed in 865us (1054us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784756049.566929:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 26 00000100:00100000:0.0:1784756049.574113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.574343:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136554368 00000100:00100000:3.0:1784756049.574353:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136554368 00000100:00100000:3.0:1784756049.574515:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 27 00000100:00100000:3.0:1784756049.574526:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136554368:12345-192.168.202.8@tcp:41:rm.0 00000004:00000024:3.0:1784756049.574583:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1784756049.574676:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136554368:12345-192.168.202.8@tcp:41:rm.0 Request processed in 152us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756049.574684:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 27 00000100:00100000:1.0:1784756049.577719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756049.577801:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136554496 00000100:00100000:3.0:1784756049.577811:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136554496 00000100:00100000:3.0:1784756049.577927:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28 00000100:00100000:3.0:1784756049.577938:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136554496:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:3.0:1784756049.577958:0:8321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756049.577980:0:8321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c37d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c61 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578160:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578250:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578263:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578279:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578286:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578292:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578480:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578488:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578496:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756049.578520:0:8321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784756049.578524:0:8321:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784756049.578540:0:8321:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578552:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578569:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578576:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578583:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578589:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74010000 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.578593:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578600:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578612:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:3.0:1784756049.578615:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.578621:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578627:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010000/0x8f2fc1536a2c37e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578769:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578777:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578783:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578797:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf74011800 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.578800:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578807:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578815:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8fcf6de9e000) 00010000:00010000:3.0:1784756049.578881:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.578887:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578893:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011800/0x8f2fc1536a2c37e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578924:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74011a00/0x8f2fc1536a2c37d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c61 expref: 18 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578937:0:8321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c61 expref: 17 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.578944:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf47b5a800) 00010000:00010000:3.0:1784756049.578947:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784756049.578949:0:8321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf74010400, rc 0) 00000100:00100000:3.0:1784756049.579171:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+17:10408:x1871452136554496:12345-192.168.202.8@tcp:101:rm.0 Request processed in 1235us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756049.579186:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28 00000100:00100000:0.0:1784756049.582855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.582947:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136554752 00000100:00100000:1.0:1784756049.582957:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136554752 00000100:00100000:1.0:1784756049.583099:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29 00000100:00100000:1.0:1784756049.583110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+17:10408:x1871452136554752:12345-192.168.202.8@tcp:36:rm.0 00010000:00010000:1.0:1784756049.583169:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784756049.583209:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf74010400/0x8f2fc1536a2c37ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c61 expref: 17 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583232:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b8c0400/0x8f2fc1536a2c379a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c45 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583265:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf47b5a800) 00010000:00010000:1.0:1784756049.583288:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c37af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c4c expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583296:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:1.0:1784756049.583300:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756049.583320:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583332:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583341:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583354:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583361:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583368:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583491:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583500:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.583518:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784756049.584255:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1784756049.584265:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291697626462ns, next at 292697624618ns, rc = 0 00010000:00010000:1.0:1784756049.584319:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584329:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584337:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584344:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584350:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584358:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584574:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784756049.584599:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584606:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584613:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584627:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dac00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.584631:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584658:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584669:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf50616700) 00010000:00010000:1.0:1784756049.584671:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784756049.584675:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584680:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dac00/0x8f2fc1536a2c3803 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584696:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584702:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584707:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584711:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da000 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.584714:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584720:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584738:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:1.0:1784756049.584740:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.584743:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.584749:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da000/0x8f2fc1536a2c37f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756049.584759:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c2c6942 reply state 000000003de457ab transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.584767:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756049.584856:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136554752:12345-192.168.202.8@tcp:36:rm.0 Request processed in 1745us (2007us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784756049.584864:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29 00000100:00100000:0.0:1784756049.588141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1784756049.588631:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588690:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588697:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588704:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3db600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.588708:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588717:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588734:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8fcf50616b00) 00010000:00010000:3.0:1784756049.588737:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.588742:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.588748:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3db600/0x8f2fc1536a2c37fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756049.588788:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555008 00000100:00100000:3.0:1784756049.588797:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555008 00000100:00100000:3.0:1784756049.588843:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:3.0:1784756049.588853:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+15:10408:x1871452136555008:12345-192.168.202.8@tcp:35:rm.0 00010000:00010000:2.0:1784756049.590130:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756049.590143:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.590153:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da400 already unused, calling callback (ffffffffc1599230) 00010000:00010000:2.0:1784756049.590156:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.590164:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756049.590606:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136555008:12345-192.168.202.8@tcp:35:rm.0 Request processed in 1748us (2468us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784756049.590616:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 5 00010000:00010000:2.0:1784756049.590757:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fcf50616700) 00010000:00010000:2.0:1784756049.590761:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784756049.590767:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.590773:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da400/0x8f2fc1536a2c380a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756049.590794:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756049.590796:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756049.590798:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756049.596977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756049.597062:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555264 00000100:00100000:1.0:1784756049.597071:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555264 00000100:00100000:1.0:1784756049.597135:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30 00000100:00100000:1.0:1784756049.597146:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:10408:x1871452136555264:12345-192.168.202.8@tcp:36:rm.0 00010000:00010000:1.0:1784756049.597215:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784756049.597242:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c37cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c5a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597264:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271e00/0x8f2fc1536a2c3769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c37 expref: 15 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597276:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf429d8f00) 00010000:00010000:1.0:1784756049.597292:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c372a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c29 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597316:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616600) 00010000:00010000:1.0:1784756049.597326:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756049.597351:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597363:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597373:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597386:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597393:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597411:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597894:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597903:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.597910:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756049.598957:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784756049.598975:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.598989:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.598996:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599016:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3daa00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.599020:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599028:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599040:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fcf50616900) 00010000:00010000:1.0:1784756049.599043:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784756049.599047:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599053:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c381f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599084:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599091:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599096:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599100:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756049.599109:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599116:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599124:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf50616500) 00010000:00010000:1.0:1784756049.599126:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756049.599129:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756049.599135:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c3811 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756049.599149:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ae4a394 reply state 000000002ff7e4fd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.599157:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756049.599762:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+15:10408:x1871452136555264:12345-192.168.202.8@tcp:36:rm.0 Request processed in 2612us (2790us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784756049.599771:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30 00010000:00010000:3.0:1784756049.609417:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609452:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609460:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609467:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dae00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756049.609472:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609481:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609499:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fcf50616800) 00010000:00010000:3.0:1784756049.609502:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756049.609507:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756049.609522:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dae00/0x8f2fc1536a2c3818 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756049.695495:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fce456a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153367424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756049.695569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756049.695709:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367424 00000100:00100000:2.0:1784756049.695731:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367424 00000100:00100000:2.0:1784756049.695787:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756049.695797:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153367424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756049.695820:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756049.699605:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153367424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3798us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.699619:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1784756049.699802:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fce456a5880 x1871452153367424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756049.699828:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fce456a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153367424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756049.951040:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756050.975570:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756051.999027:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756052.895860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756052.895902:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756052.895935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756052.896101:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555520 00000100:00100000:2.0:1784756052.896112:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555520 00000100:00100000:1.0:1784756052.896161:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555392 00000100:00100000:1.0:1784756052.896166:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555392 00000100:00100000:2.0:1784756052.896192:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 91 00000100:00100000:1.0:1784756052.896192:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 234 00000100:00100000:1.0:1784756052.896200:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136555392:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756052.896201:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+14:2354:x1871452136555520:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756052.896288:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+14:2354:x1871452136555520:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756052.896295:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 91 00000100:00100000:3.0:1784756052.896321:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555648 00000100:00100000:3.0:1784756052.896336:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555648 00000100:00100000:3.0:1784756052.896373:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 40 00000100:00100000:3.0:1784756052.896381:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136555648:12345-192.168.202.8@tcp:400:kworker.0 00000100:00080000:0.0:1784756052.896435:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756052.896439:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756052.902427:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2354:x1871452136555392:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 6028us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756052.902444:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 234 00000100:00100000:3.0:1784756052.902633:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2354:x1871452136555648:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 6251us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756052.902923:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 40 00010000:00010000:2.0:1784756053.022920:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756053.790962:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7fe56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153367936:0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.791055:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756053.791162:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784756053.791169:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7fe55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153367552:0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.791205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756053.791241:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153368064:0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.791268:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756053.791306:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368064 00000100:00100000:0.0:1784756053.791313:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368064 00000100:00100000:0.0:1784756053.791382:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784756053.791394:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153368064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.791447:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1871452153368064:12345-0@lo:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756053.791454:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1784756053.791474:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756053.791507:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf80857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1871452153368064:0@lo:400:kworker.0 00000100:00100000:1.0:1784756053.791597:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367936 00000100:00100000:1.0:1784756053.791602:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367936 00000100:00100000:1.0:1784756053.791669:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756053.791677:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153367936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756053.791716:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153367936:12345-0@lo:400:kworker.0 Request processed in 41us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756053.791722:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756053.791742:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367552 00000100:00100000:1.0:1784756053.791746:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367552 00000100:00100000:1.0:1784756053.791767:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784756053.791772:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153367552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756053.791798:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf6dfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3314:x1871452153367552:12345-0@lo:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756053.791803:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784756053.791837:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7fe55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3314:1871452153367552:0@lo:400:kworker.0 00010000:00080000:1.0:1784756053.791851:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7fe56a00 x1871452153367936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756053.791861:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7fe56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153367936:0@lo:400:kworker.0 00000100:00080000:0.0:1784756053.791999:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756053.792172:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7fe55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153367808:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792216:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756053.792260:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784756053.792267:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153367680:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792291:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756053.792310:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153368192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792337:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756053.792375:0:7966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368192 00000100:00100000:3.0:1784756053.792380:0:7966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368192 00000100:00100000:3.0:1784756053.792416:0:7966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756053.792424:0:7966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153368192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792462:0:7966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1871452153368192:12345-0@lo:400:kworker.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756053.792468:0:7966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1784756053.792633:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756053.792672:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf7bd77100 x1871452153368192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756053.792683:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1871452153368192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792701:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367808 00000100:00100000:3.0:1784756053.792705:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367808 00000100:00100000:3.0:1784756053.792732:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153367680 00000100:00100000:3.0:1784756053.792735:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153367680 00000100:00100000:3.0:1784756053.792751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784756053.792757:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153367808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792791:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1871452153367808:12345-0@lo:400:kworker.0 Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756053.792797:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784756053.792816:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784756053.792822:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153367680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792850:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1871452153367680:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756053.792856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1784756053.792868:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756053.792887:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1871452153367680:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.792897:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7fe55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1871452153367808:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.793311:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756053.793323:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fce456a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153368320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756053.793371:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756053.793455:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368320 00000100:00100000:1.0:1784756053.793460:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368320 00000100:00100000:1.0:1784756053.793499:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784756053.793507:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153368320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756053.793545:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756053.793593:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153368320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756053.793601:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1784756053.793734:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fce456a4700 x1871452153368320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756053.793750:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fce456a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153368320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756054.046875:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784756054.818827:0:6851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296932185832ns, next at 297932183271ns, rc = 0 00000100:00100000:1.0:1784756054.818968:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153368448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756054.819061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756054.819350:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368448 00000100:00100000:2.0:1784756054.819358:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368448 00000100:00100000:2.0:1784756054.819410:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784756054.819419:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153368448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756054.819451:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756054.819491:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153368448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756054.819508:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1784756054.820042:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fcf605d9180 x1871452153368448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756054.820060:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153368448:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784756054.875992:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:0.0:1784756054.876008:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1784756054.876016:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784756054.876691:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153368576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784756054.876763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756054.877396:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368576 00000100:00100000:1.0:1784756054.877405:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368576 00000100:00100000:1.0:1784756054.877463:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756054.877473:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1871452153368576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784756054.877504:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1784756054.877543:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a613752, atime: 0x6a613752, ctime: 0x6a613752, blocks: 0x1 00010000:00010000:1.0:1784756054.877552:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.877571:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1784756054.877576:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756054.877584:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.877606:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.877667:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.877695:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.877716:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784756054.878288:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1871452153368576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 815us (1522us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784756054.878295:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1784756054.878321:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756054.878326:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.878335:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da600 already unused, calling callback (ffffffffc1599230) 00010000:00010000:1.0:1784756054.878339:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.878348:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.878364:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.878372:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cc0bc1b/0x8f2fc1536a2c3826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.878396:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756054.878398:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756054.878400:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784756054.878437:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fcf605d9180/2, rc 0, transno 4294967300 00000100:00100000:1.0:1784756054.878444:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1871452153368576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784756054.908940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756054.909094:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555776 00000100:00100000:3.0:1784756054.909104:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555776 00000100:00100000:3.0:1784756054.909252:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 31 00000100:00100000:3.0:1784756054.909264:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:10918:x1871452136555776:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:3.0:1784756054.909292:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756054.909322:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c382d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c68 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909406:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909420:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909433:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756054.909798:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784756054.909802:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:0.0:1784756054.909865:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1784756054.909932:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909964:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c382d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c68 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909983:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c68 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756054.909991:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf6de9e000) 00010000:00010000:3.0:1784756054.909994:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784756054.909998:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030200, rc 0) 00000100:00100000:3.0:1784756054.910072:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10918:x1871452136555776:12345-192.168.202.8@tcp:101:rm.0 Request processed in 811us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756054.910080:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 31 00000100:00100000:0.0:1784756054.919756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756054.919851:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136555904 00000100:00100000:1.0:1784756054.919861:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136555904 00000100:00100000:1.0:1784756054.919922:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 32 00000100:00100000:1.0:1784756054.919933:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10918:x1871452136555904:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:1.0:1784756054.919954:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756054.919974:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c383b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c6f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920045:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920059:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920069:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920124:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920131:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920157:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920408:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920416:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920423:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920428:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3daa00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756054.920432:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920439:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920451:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf6de9e000) 00010000:00010000:1.0:1784756054.920454:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756054.920459:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920465:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3daa00/0x8f2fc1536a2c3842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920476:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920482:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920494:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920500:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dbe00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756054.920503:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920510:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920518:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff8fcf50616900) 00010000:00010000:1.0:1784756054.920521:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756054.920524:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920530:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c3849 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920566:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c383b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c6f expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920576:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf6de9e000) 00010000:00010000:1.0:1784756054.920578:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784756054.920582:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c383b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c6f expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756054.920590:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3da600, rc 0) 00000100:00100000:1.0:1784756054.920856:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:10918:x1871452136555904:12345-192.168.202.8@tcp:101:rm.0 Request processed in 923us (1109us total) trans 0 rc 301/301 00000100:00100000:1.0:1784756054.920872:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 32 00010000:00010000:0.0:1784756055.075900:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756056.094968:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756057.133431:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756057.536574:0:11700:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 119l: test nohybrid flag prevents hybrid IO switching ========================================================== 17:34:17 (1784756057) 00000100:00100000:0.0:1784756057.700055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756057.700142:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556160 00000100:00100000:3.0:1784756057.700153:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556160 00000100:00100000:3.0:1784756057.700227:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 33 00000100:00100000:3.0:1784756057.700238:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:11157:x1871452136556160:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1784756057.700263:0:8321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756057.700266:0:8321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784756057.700294:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030200/0x8f2fc1536a2c3834 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c68 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700315:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf6de9e000) 00010000:00010000:3.0:1784756057.700327:0:8321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756057.700342:0:8321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c3850 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c76 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700711:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700726:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700735:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700792:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700800:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.700819:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784756057.701604:0:8321:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784756057.701891:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030a00/0x8f2fc1536a2c3865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701902:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030a00/0x8f2fc1536a2c3865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701910:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030a00/0x8f2fc1536a2c3865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701944:0:8321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701960:0:8321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701967:0:8321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701974:0:8321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40031600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:3.0:1784756057.701978:0:8321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701986:0:8321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.701996:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf6de9e300) 00010000:00010000:3.0:1784756057.701999:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756057.702019:0:8321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.702026:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c3857 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784756057.702040:0:8321:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4d28d14 reply state 0000000005e91842 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756057.702049:0:8321:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784756057.702081:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c3850 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c76 expref: 8 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.702097:0:8321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030a00/0x8f2fc1536a2c3865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c76 expref: 7 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756057.702114:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:3.0:1784756057.702116:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784756057.702119:0:8321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40030a00, rc 0) 00000100:00100000:3.0:1784756057.702190:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:11157:x1871452136556160:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1953us (2145us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784756057.702198:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 33 00000100:00080000:0.0:1784756057.702458:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756057.707355:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707374:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707382:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707388:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030e00 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756057.707393:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707401:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707420:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff8fcf6de9e500) 00010000:00010000:1.0:1784756057.707424:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756057.707428:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.707434:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030e00/0x8f2fc1536a2c385e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756057.797531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756057.797686:0:7966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556288 00000100:00100000:3.0:1784756057.797697:0:7966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556288 00000100:00100000:3.0:1784756057.797739:0:7966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:3.0:1784756057.797747:0:7966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1871452136556288:12345-192.168.202.8@tcp:8:kworker.0 00010000:00080000:3.0:1784756057.797786:0:7966:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417@192.168.202.8@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1784756057.797819:0:7966:0:(genops.c:1406:class_connect()) connect: client 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417, cookie 0x8f2fc1536a2c3873 00002000:00100000:3.0:1784756057.797830:0:7966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417/ffff8fcf8081b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784756057.797858:0:7966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784756057.798795:0:7966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784756057.798832:0:7966:0:(import.c:65:import_set_state_nolock()) ffff8fce44a94000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756057.798906:0:7966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2353:x1871452136556288:12345-192.168.202.8@tcp:8:kworker.0 Request processed in 1157us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756057.798915:0:7966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 15 00000100:00100000:0.0:1784756057.808965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756057.809142:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556416 00000100:00100000:1.0:1784756057.809155:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556416 00000100:00100000:1.0:1784756057.809257:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 0 00000100:00100000:1.0:1784756057.809268:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136556416:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1784756057.809334:0:6595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784756057.809343:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.809360:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1784756057.809365:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756057.809373:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.809390:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784756057.810607:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756057.816698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756057.817218:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784756057.817228:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1784756057.818770:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556544 00000100:00100000:0.0:1784756057.818782:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556544 00000100:00100000:1.0:1784756057.819450:0:11712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1 00000100:00100000:1.0:1784756057.819462:0:11712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:2357:x1871452136556544:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:1.0:1784756057.819500:0:11712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.819518:0:11712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756057.819523:0:11712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756057.819530:0:11712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756057.819546:0:11712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784756057.868798:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48fa1c5d-1a6c-46e1-9f99-5b087c9e4417 00000001:00080000:3.0:1784756057.915441:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00002000:00010000:0.0:1784756057.915542:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1784756057.915547:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784756058 00002000:00010000:0.0:1784756057.915550:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784756058 00002000:00010000:0.0:1784756057.915551:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1784756057.915566:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915579:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915588:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915604:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3daa00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784756057.915608:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915617:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915693:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756057.915700:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e159b4f/0x8f2fc1536a2c387a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756057.915791:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:2356:x1871452136556416:12345-192.168.202.8@tcp:4:dd.0 Request processed in 106519us (106830us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784756057.915804:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 0 00002000:00010000:2.0:1784756057.973742:0:11712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1784756057.973762:0:11712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973775:0:11712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973785:0:11712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973793:0:11712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3da000 already unused, calling callback (ffffffffc1599230) 00010000:00010000:2.0:1784756057.973798:0:11712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973807:0:11712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973829:0:11712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756057.973837:0:11712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e9bbdd/0x8f2fc1536a2c3881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756057.973937:0:11712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2357:x1871452136556544:12345-192.168.202.8@tcp:4:dd.0 Request processed in 154472us (157243us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756057.973967:0:11712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1 00000001:00080000:3.0:1784756057.974132:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1784756057.989783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756057.990044:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556800 00000100:00100000:0.0:1784756057.990056:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556800 00000100:00100000:0.0:1784756057.990126:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00100000:0.0:1784756057.990137:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:11157:x1871452136556800:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:0.0:1784756057.990463:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:11157:x1871452136556800:12345-192.168.202.8@tcp:35:dd.0 Request processed in 327us (689us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784756057.990472:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 6 00000100:00100000:1.0:1784756058.012894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756058.012943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756058.013137:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557056 00000100:00100000:2.0:1784756058.013151:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557056 00000100:00100000:2.0:1784756058.013255:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 43 00000100:00100000:2.0:1784756058.013268:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2355:x1871452136557056:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1784756058.013374:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2355:x1871452136557056:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 110us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.013384:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 43 00000100:00100000:0.0:1784756058.013662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136556928 00000100:00100000:0.0:1784756058.013666:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136556928 00000100:00100000:0.0:1784756058.013694:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 236 00000100:00100000:0.0:1784756058.013701:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2355:x1871452136556928:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1784756058.013731:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce9a21a-c6b6-4a15-be59-725c4253efd6+10:2355:x1871452136556928:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 31us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.013737:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 236 00000100:00080000:3.0:1784756058.013892:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756058.091498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756058.091704:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557184 00000100:00100000:2.0:1784756058.091714:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557184 00000100:00100000:2.0:1784756058.091778:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 34 00000100:00100000:2.0:1784756058.091788:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:11164:x1871452136557184:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1784756058.091811:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756058.091835:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270800/0x8f2fc1536a2c3888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c7d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.091901:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c388f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.091917:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c388f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.091931:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c388f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756058.091993:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756058.092032:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756058.092061:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c388f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.092259:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270800/0x8f2fc1536a2c3888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c7d expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.092278:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270a00/0x8f2fc1536a2c388f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c7d expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.092286:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf429d8500) 00010000:00010000:2.0:1784756058.092288:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756058.092292:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43270a00, rc 0) 00000100:00100000:2.0:1784756058.092359:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:11164:x1871452136557184:12345-192.168.202.8@tcp:101:dd.0 Request processed in 572us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.092366:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 34 00000100:00100000:0.0:1784756058.097693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756058.098201:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557440 00000100:00100000:3.0:1784756058.098211:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557440 00000100:00100000:3.0:1784756058.098269:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 35 00000100:00100000:3.0:1784756058.098278:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fce456a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:11164:x1871452136557440:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1784756058.098298:0:8321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756058.098318:0:8321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c3896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c84 expref: -99 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.098414:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c389d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.098427:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.098439:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756058.098450:0:8321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:3.0:1784756058.098572:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031200/0x8f2fc1536a2c3896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c84 expref: 12 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.098606:0:8321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c389d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c84 expref: 11 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.098615:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:3.0:1784756058.098618:0:8321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784756058.098622:0:8321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf40031600, rc 0) 00000100:00100000:3.0:1784756058.098730:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fce456a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:11164:x1871452136557440:12345-192.168.202.8@tcp:101:dd.0 Request processed in 452us (1047us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784756058.098752:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 35 00000100:00100000:1.0:1784756058.113033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756058.113234:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557568 00000100:00100000:2.0:1784756058.113244:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557568 00000100:00100000:2.0:1784756058.113317:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2 00000100:00100000:2.0:1784756058.113335:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:2356:x1871452136557568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784756058.113350:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756058.113374:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40031600/0x8f2fc1536a2c389d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c84 expref: 11 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.113394:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:2.0:1784756058.113398:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756058.113460:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:2356:x1871452136557568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 127us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.113468:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2 00000100:00100000:1.0:1784756058.120231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.120625:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557696 00000100:00100000:0.0:1784756058.120670:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557696 00000100:00100000:0.0:1784756058.120725:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 16 00000100:00100000:0.0:1784756058.120734:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+5:2355:x1871452136557696:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1784756058.120754:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756058.120775:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000627db7a5/0x8f2fc1536a2c38ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c8b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784756058.120802:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a61375a, atime: 0x0, ctime: 0x6a61375a, blocks: 0x1007 00010000:00010000:0.0:1784756058.120823:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1784756058.120827:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.120837:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000627db7a5/0x8f2fc1536a2c38ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c8b expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.120854:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000627db7a5/0x8f2fc1536a2c38ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c8b expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.120867:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b8c0c00, rc 0) 00000100:00100000:0.0:1784756058.120918:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2355:x1871452136557696:12345-192.168.202.8@tcp:101:dd.0 Request processed in 185us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.120925:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 16 00010000:00010000:1.0:1784756058.146882:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756058.231039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756058.231557:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557824 00000100:00100000:1.0:1784756058.231567:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557824 00000100:00100000:1.0:1784756058.231670:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2 00000100:00100000:1.0:1784756058.231681:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136557824:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1784756058.231715:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.231732:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756058.231736:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756058.231743:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.231756:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756058.236963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.242239:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136557952 00000100:00100000:0.0:1784756058.242254:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136557952 00000100:00100000:0.0:1784756058.242345:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:0.0:1784756058.242356:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:2357:x1871452136557952:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1784756058.242390:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.242423:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.242428:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.242435:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.242450:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306508:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306531:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306541:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306549:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b3dbc00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784756058.306556:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306565:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306598:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.306624:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73a68e1/0x8f2fc1536a2c38b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756058.306764:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+8:2357:x1871452136557824:12345-192.168.202.8@tcp:3:dd.0 Request processed in 75079us (75729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1784756058.306776:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2 00010000:00010000:0.0:1784756058.331908:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.331941:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.331957:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.331966:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf7b8c0400 already unused, calling callback (ffffffffc1599230) 00010000:00010000:0.0:1784756058.331972:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.331980:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.332010:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.332018:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001622c6b1/0x8f2fc1536a2c38b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756058.332119:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2357:x1871452136557952:12345-192.168.202.8@tcp:3:dd.0 Request processed in 89760us (95170us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1784756058.332129:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:2.0:1784756058.388207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.389556:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136558208 00000100:00100000:0.0:1784756058.389568:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136558208 00000100:00100000:0.0:1784756058.389681:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 7 00000100:00100000:0.0:1784756058.389691:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+10:11164:x1871452136558208:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:1.0:1784756058.390402:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:11164:x1871452136558208:12345-192.168.202.8@tcp:35:dd.0 Request processed in 709us (2200us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784756058.390415:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 7 00000100:00100000:2.0:1784756058.477707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756058.477809:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136558464 00000100:00100000:1.0:1784756058.477819:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136558464 00000100:00100000:1.0:1784756058.477877:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36 00000100:00100000:1.0:1784756058.477901:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+11:11168:x1871452136558464:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:1.0:1784756058.477940:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756058.477970:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c38c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c92 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.478119:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c38c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.478138:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c38c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.478149:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c38c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756058.478162:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:1.0:1784756058.478322:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3dbe00/0x8f2fc1536a2c38c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c92 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.478342:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf7b3da600/0x8f2fc1536a2c38c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c92 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.478350:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:1.0:1784756058.478353:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784756058.478356:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf7b3da600, rc 0) 00000100:00100000:1.0:1784756058.478435:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:11168:x1871452136558464:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 527us (731us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784756058.479153:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36 00000100:00100000:0.0:1784756058.492542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1784756058.492927:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136558720 00000100:00100000:3.0:1784756058.492937:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136558720 00000100:00100000:3.0:1784756058.493018:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 37 00000100:00100000:3.0:1784756058.493029:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:11168:x1871452136558720:12345-192.168.202.8@tcp:36:lfs.0 00010000:00010000:3.0:1784756058.493092:0:8321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756058.493331:0:8321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030a00/0x8f2fc1536a2c3865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c76 expref: 13 pid: 8321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.493351:0:8321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:3.0:1784756058.493356:0:8321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756058.493379:0:8321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.493393:0:8321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756058.493402:0:8321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784756058.493599:0:8321:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000565f63ac reply state 00000000f9bfd49e transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756058.493609:0:8321:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784756058.493761:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+14:11168:x1871452136558720:12345-192.168.202.8@tcp:36:lfs.0 Request processed in 733us (1231us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1784756058.493768:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 37 00000100:00100000:3.0:1784756058.500592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1784756058.500803:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756058.500831:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136558848 00010000:00010000:1.0:1784756058.500835:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756058.500840:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136558848 00010000:00010000:1.0:1784756058.500841:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.500847:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf40030600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:1.0:1784756058.500852:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.500858:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.500873:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:1.0:1784756058.500876:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756058.500881:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.500887:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf40030600/0x8f2fc1536a2c38d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8321 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756058.500902:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 17 00000100:00100000:2.0:1784756058.500912:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136558848:12345-192.168.202.8@tcp:2:lfs.0 00002000:00010000:2.0:1784756058.501203:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1784756058.501207:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1784756058 -> 1784756058 00002000:00010000:2.0:1784756058.501209:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784756058.501211:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1784756058 -> 1784756058 00002000:00010000:2.0:1784756058.501213:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1784756058.501285:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2356:x1871452136558848:12345-192.168.202.8@tcp:2:lfs.0 Request processed in 373us (702us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784756058.501293:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 17 00000100:00100000:2.0:1784756058.534882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.535055:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136558976 00000100:00100000:0.0:1784756058.535068:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136558976 00000100:00100000:0.0:1784756058.535135:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:0.0:1784756058.535146:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:5567:x1871452136558976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784756058.535163:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756058.535207:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000627db7a5/0x8f2fc1536a2c38ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c8b expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.535237:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756058.535294:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:5567:x1871452136558976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 151us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.535301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3 00000100:00100000:1.0:1784756058.608962:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1784756058.609222:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136559232 00000100:00100000:2.0:1784756058.609232:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136559232 00000100:00100000:2.0:1784756058.609293:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 38 00000100:00100000:2.0:1784756058.609303:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+13:11175:x1871452136559232:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1784756058.609328:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756058.609349:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270800/0x8f2fc1536a2c38dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2c99 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609422:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609437:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609468:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609484:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609492:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.609498:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610668:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c38f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610681:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c38f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610689:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c38f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756058.610699:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:2.0:1784756058.610790:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610797:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610804:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610809:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43270400 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756058.610822:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610829:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610839:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fcf429d8500) 00010000:00010000:2.0:1784756058.610842:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756058.610846:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610852:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270400/0x8f2fc1536a2c38e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610863:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610868:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610873:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610878:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf43271600 already unused, calling callback (ffffffffc1fd74f0) 00010000:00010000:2.0:1784756058.610880:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610885:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610890:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff8fcf429d8e00) 00010000:00010000:2.0:1784756058.610892:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756058.610898:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610903:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271600/0x8f2fc1536a2c38ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610953:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43270800/0x8f2fc1536a2c38dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c99 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610967:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fcf43271000/0x8f2fc1536a2c38f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2c99 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756058.610973:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fcf6de9e200) 00010000:00010000:2.0:1784756058.610975:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784756058.610977:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf43271000, rc 0) 00000100:00100000:2.0:1784756058.611313:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+15:11175:x1871452136559232:12345-192.168.202.8@tcp:101:dd.0 Request processed in 2010us (2359us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784756058.611321:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 38 00000100:00100000:3.0:1784756058.614502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1784756058.615178:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136559488 00000100:00100000:1.0:1784756058.615189:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136559488 00000100:00100000:1.0:1784756058.615244:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:1.0:1784756058.615251:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf807d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+15:11175:x1871452136559488:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:1.0:1784756058.615520:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf807d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+16:11175:x1871452136559488:12345-192.168.202.8@tcp:35:dd.0 Request processed in 268us (1029us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784756058.615526:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 8 00000100:00100000:1.0:1784756058.626904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.627067:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136559616 00000100:00100000:0.0:1784756058.627077:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136559616 00000100:00100000:0.0:1784756058.627326:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 18 00000100:00100000:0.0:1784756058.627337:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+6:2356:x1871452136559616:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1784756058.627369:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756058.627390:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900ff9e6/0x8f2fc1536a2c38ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa1c4d19e2c6c2ca0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784756058.627419:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a61375a, atime: 0x0, ctime: 0x6a61375a, blocks: 0x1007 00010000:00010000:0.0:1784756058.627438:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1784756058.627442:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.627452:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900ff9e6/0x8f2fc1536a2c38ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2ca0 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.627468:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000900ff9e6/0x8f2fc1536a2c38ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa1c4d19e2c6c2ca0 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.627482:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fcf48815600, rc 0) 00000100:00100000:0.0:1784756058.627587:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2356:x1871452136559616:12345-192.168.202.8@tcp:101:dd.0 Request processed in 252us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.627594:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 18 00000100:00100000:0.0:1784756058.671058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.672701:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136559744 00000100:00100000:0.0:1784756058.672718:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136559744 00000100:00100000:0.0:1784756058.672800:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 4 00000100:00100000:0.0:1784756058.672812:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2354:x1871452136559744:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1784756058.672860:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.672877:0:6596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.672892:0:6596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.672898:0:6596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.672912:0:6596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756058.675656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1784756058.685713:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452136559872 00000100:00100000:0.0:1784756058.685730:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452136559872 00000100:00100000:0.0:1784756058.685797:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:0.0:1784756058.685807:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf605da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:2355:x1871452136559872:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1784756058.685842:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.685858:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.685863:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756058.685869:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756058.685884:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694613:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694651:0:6596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694662:0:6596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694670:0:6596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf48814000 already unused, calling callback (ffffffffc1599230) 00010000:00010000:1.0:1784756058.694675:0:6596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694683:0:6596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694702:0:6596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.694709:0:6596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6b5871b/0x8f2fc1536a2c3906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756058.694815:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+9:2354:x1871452136559744:12345-192.168.202.8@tcp:3:dd.0 Request processed in 22001us (23765us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756058.694827:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 4 00010000:00010000:1.0:1784756058.697126:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697170:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697179:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697186:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fcf48815a00 already unused, calling callback (ffffffffc1599230) 00010000:00010000:1.0:1784756058.697191:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697199:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697219:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756058.697228:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c34eac/0x8f2fc1536a2c390d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756058.697312:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf605da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48fa1c5d-1a6c-46e1-9f99-5b087c9e4417+7:2355:x1871452136559872:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11501us (21675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756058.697423:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 5 00000100:00100000:1.0:1784756058.911481:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153368704:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911614:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153369216:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911674:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911697:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784756058.911703:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153368832:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911721:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911736:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153369344:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911756:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911779:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153368960:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911798:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911811:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756058.911816:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf7c101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369088:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.911833:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756058.911861:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153369344 00000100:00100000:1.0:1784756058.911869:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153369344 00000100:00100000:1.0:1784756058.911916:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153369088 00000100:00100000:1.0:1784756058.911918:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153369088 00000100:00100000:1.0:1784756058.911938:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784756058.911946:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.912172:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1871452153369344:12345-0@lo:400:kworker.0 Request processed in 225us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756058.912179:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784756058.912197:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784756058.912203:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1871452153369088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.912235:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1871452153369088:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756058.912241:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1784756058.912259:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784756058.912269:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756058.912299:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369088:0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912406:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368704 00000100:00100000:2.0:1784756058.912411:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368704 00000100:00100000:2.0:1784756058.912443:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784756058.912450:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153368704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912484:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33+19:3316:x1871452153368704:12345-0@lo:400:kworker.0 Request processed in 34us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.912489:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784756058.912542:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153369216 00000100:00100000:2.0:1784756058.912545:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153369216 00000100:00100000:2.0:1784756058.912575:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368832 00000100:00100000:2.0:1784756058.912584:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368832 00000100:00100000:2.0:1784756058.912597:0:8321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153368960 00000100:00100000:2.0:1784756058.912600:0:8321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153368960 00000100:00100000:2.0:1784756058.912613:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784756058.912618:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153369216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912675:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1871452153369216:12345-0@lo:400:kworker.0 Request processed in 56us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.912680:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784756058.912691:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784756058.912696:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7bd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153368832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912719:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7bd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1871452153368832:12345-0@lo:400:kworker.0 Request processed in 23us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.912724:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784756058.912734:0:8321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784756058.912739:0:8321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153368960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912764:0:8321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1871452153368960:12345-0@lo:400:kworker.0 Request processed in 25us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.912770:0:8321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1784756058.912783:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756058.912818:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1871452153368832:0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912829:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1871452153369344:0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912835:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fbcb7fb-13d6-49e7-b832-bcc1bebcfc33:3316:1871452153368704:0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.912843:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1871452153369216:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.912921:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf7c103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1871452153368960:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.913287:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf807d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756058.913430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756058.915675:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153369472 00000100:00100000:2.0:1784756058.915688:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153369472 00000100:00100000:2.0:1784756058.915831:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784756058.915842:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153369472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756058.915883:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1784756058.915971:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1871452153369472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.915979:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784756058.916097:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf807d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784756059.166861:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756059.938135:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756059.938159:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756059.938235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756059.938317:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452153369600 00000100:00100000:2.0:1784756059.938325:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452153369600 00000100:00100000:2.0:1784756059.938370:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756059.938378:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fcf80772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1871452153369600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756059.938414:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756059.938459:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fcf80772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1871452153369600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756059.938466:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756059.938513:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8fcf605d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1871452153369600:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784756060.018970:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000001:00080000:0.0:1784756060.019002:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000004:00080000:0.0:1784756060.019018:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1784756060.033882:0:6615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1784756060.194202:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756060.330225:0:11753:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_119l: @@@@@@ FAIL: (5) nohybrid should prevent switch, stats: 1 00010000:00010000:2.0:1784756061.216495:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9502 lines, 9502 kept, 0 dropped, 0 bad.